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I'l Krasffick 

( 2 IJONA.KKOSNICK, called as a 
PI witness, having ^cn duly sworn by a Notary 
H] Public, was examined and tcsiificd as 
[S] follows; 

|Gi EXAMINATION BY 

[71 MN. BLEAKLEY: 

W O; Good morning. Or. Krosnick. • 

(9) A: Good morning. 

ftoi Q: You understand that this is the _ 

ti] continuation of your dct3osition in this case? 

It 2 i A: I do. 

[ 1 .^ Q: And that you arc still under oath? 
ii4] A: Yes. 

I»sj Q: The Iasi deposition, the first day of 

(iR this depiosjtiOR was taken on February 12. [>o you 

[17] remember that? 

}i«] A: Yes, 1 do. 

{>9i Q: Have you done any work on this case 
(201 since February 12th? 

121 ] A: Yes, I have. 

[77] Q: What work have you done? 

[231 A: I have been reading materials relevant 
P4] to the case, almost alt of which arc pan of the 
[7S| maicriaJs ihai 1 understand have been turned over 
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2—09:3a;00 


]•) 


P! 

HI 


25—<J9 39:41 
Krosntck 

(7i to you some time ago, prior to my last deposition. 
There arc some nesv materials, ihougli, that I have 
read that have not been included in that earlier 
isi batch. 

m 1 have also done statistical artalysis of 
[71 thc^tel s^fvey dau. 1 have also done some 
m thii^nga|^ut and gained some information about 
I9| the o^^^tions that 1 analyacd. 

Anything else? 

i^^^at I remember at the nximent. 
l^tc,Apprpxiinaicly how many hours have you 
|i3{ spe^^^^^ng on this ease and the things 

|i«l thid^^^ described since Febj " ' 

(isi iKTCpproximately 25 to 30, bu 
1'^ » records to be sure 

[171 O: You ^ pretty conTidcnt it 


be 31. It's in the ninj 


ia<i Q: Have you had any meeting: 
<? 2 | fororoeipiescniatives of the plai 
73 , case 

A: 

Q »ny timtSC^ you 
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rO! 

(Ill 

l‘21 





them? 


Krosn^ 
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xcusc me, twice. 
i?was that? 

ay and this morning, 
any hours did you ling 

I yesterday and this ritozaisig^ 

Sd say 30 minutes this moniin| 
m five h<pil^stcrday. 

« O' 

r. Bschorr? 


land 



back to the work that you said 
■■I you February 12ih and today. 

ISI First, you saidyou reviewed materials, including 
^ teteviewing some of the materials you had seen 
?i( before and also some new materials, right? 
ai A: Yes. 

!3| Q; What are the materials that you had 

>») reviewed before that you reviewed again? 

:si A: 1 didn't say that I had reviewed them 


I 2 —09 40.55 25 — 09 : 42:19 Page 205 

^ |i| Krosnick 

I [ 2 ] before. 1 said that it was my understanding that 

! |3| they had been turned over before to you. 

|4| Q; Okay. 

(sj A: These were things that 1 had been given 
HI previously but hadn't read until recently and they 
171 are primarily publications by KipViscusi. 

I9j I have also, since the last deposition 
[»[ reread my own reports and my deposition transcript, 
imi Q: Anything else? 

[Ill A: I am sorry, anything else in which 
|t 2 i category? 

(131 Q; Anything else that you had before that 
[i4| you reviewed between February I 2 and today.You 
[ISI mentioned primarily Viscusi publications. I want 
ii«i to know if there are publications and materials 
[o) other than those produced by Professor Viscusi. 

[i»i A; 1 think I read 10 to 15 pages of an 

[19! article or report by John Hanson, i believe his 

fjq name is, but that would be it. 

pil Q; So you reread your reports in this ease, 

Irti you read the transcript of your deposition on 
1231 February 12, you read some Viscusi publications and 
[23] you read a paper prepared by John Hanson, 
pal A; Yes. _ 

2 — 09 : 42:19 25 — 09 : 43:30 Page 206 

lil Krosnick 

[21 Q'- Anything else? 

PI A: Of materials that I had been given 
W before? 

I5I Q; Yes. . 

lei A; Not that 1 remember. 

[71 Q: In reviewing your deposition transcript 
m from February 12, did you find anything that was 
(91 wrong or that you wdbt to change or correct? 

|io! A; I found a few sentences, maybe two to 
[1 u three, where 1 am quite sure there was a 
1171 transcription error, but I don't — but 1 didn't 
[131 consider them serious enough to raise — 1 have 
[14] never been asked to evaluate the accuracy of that 
Ii5j or to report any transcription errors that might 
[161 have occurred, but 1 don't remember anything, other 
11/1 than transcription errors that I noticed that was 
liBi incorrect or needing repair, 

[191 Q; What was the reason why you were 
(201 reviewing a paper written by John Hanson? 

[211 A: It was among materials that 1 have been 
122 ) given by Dewey Ballantinc as (xiicntially helpful in 
[231 this case, so I am working my way through those 

pvi materials. 

ps! Q: What are the new materials that you have 
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l,i Krosnick 

PI been provided? 1 lake it, when you say new 
PI materials, are these new materials (hat have been 
I 4 i provided to you by Dewey Ballaminc? 

151 A; Sonic arc and some arc materials that I 
(6! poi on my own. 

^ Let s Stan with the new materials that 

l«! wcrl provided by Dewey Ballaiitinc.Vi'hat do they 
' ■“fs.stof? 

A: One item is a repon by the Roper survey 
lization to the FedcralTradc Commission 
describine the results of survey data that Roper 
cted at the FTC's exMnse in 1980 I have 
given information byl>e^jgBallaminc on the 
at which selected were successfully 

sed for the data set that I analyzed, i have 
iveti information a^t^^th^demographic 
cieristics of Blue Cr^^^^^^hicld claimants 
een the years 1992 I have been given 

paper anicics rctcva^^^^iacco. 

I'am sorry, just to I 

materials 

Sfvc been provided to you s||'<7e your 
sit ion oi^^^^ua ry l^^^^ed to you by Dewey 

35V.. 

Page 288 



pin hear the question again 
— ^■w.J'he question is. wh: 





poi 

P'l 

P3| 

I»I 

PSl 


mine, that you have 

I got a document referred to 

^ i^e imerrogatives in this, relftni nt to this 
What it contains is sutemems 

ic cither at press conferences “br in the news 
iia by tobacco industi^rcrnpteiyccs over the years, 
't be nxjtt specific exactly that 

mem is. It's been rerc^^oto with numbers 
1^62 and 63 or 63 and ^^^l^hing of that 

believe that's all. 

Why were you provided these documents by 
cy Ballaminc, if you know? 

A: Well, the newspaper articles and the 

lives listing was at my request, because 1 
interested in learning more about sutemems 
IC'j o the American public by the tobacco industry 
e years.Thc information on the. what we 
might call the response rate for the depositions 
taken in this c-asc from subscribers wa.s also at my 
reqbesu6undprsundthiLpt»crSs'TlitJtop&r- ' 
study report vvas also made at my request because 
that svas a survey that I became asvarc of the 
existence of and felt — 


2—09:47:52 25—09 49:11 

Krosnick 

Q: How did you become aware of the 


Page 289 


PI existence of it^ 

I4i A: I saw it described in a fax (hat I 
isi received of visual displays that were used by 
IS] Professor'Viscusi in the Falisc case during his 
m testimony, so that would be another document 1 
IB| received and consulted since February 12ih. 

I»{ Q: Would you describe that again for us, 

[io| please? 

|ii; A: Yes What 1 received was a fax with a 

Ii 2 ;i reproduction with, 1 believe, of some or all of the 

|i31 visual displays used by Professor Kip Viscusi 

lift during his testimony in the Fatise case, and one of 

|t5] those visual displays had a footnote indicating the 

| 1 E| dau were taken from a 1980 Roper survey done for 

1171 the Federal Trade Ckimmission, and I had not been 

ii«i aware of the existence of that survey before, so I 

11 SP 1 asked to get a repon on the results. 

poi 0: So you were provided by Dewey Ballantine 

PM with a copy of this; is that right? 

P 21 A: Yes, 1 was. 

[Dl I am sorry, one other thing I have 

[Ml remembered that I received was yet another 

[751 unreadable copy of the primary survey analyzed by 


2—09 49:15 


25—09:50:24 
111 Krosnick 

PI Professor Viscusi in his'book about smoking. I 
[3l continue to look forward to getting a readable copy 
['ll of that. 

[S] Q: Okay, so the new materials that were 
(*! provided to you by Dewey Ballantine since February 
[77 12 have been the Roper materials for the FTC that 
[»i you just talked abenn, something that you described 
I9i as response rates for the deponents in the 
(iq so-called deposition survey; is that right? 

(11] A; Right. 

(171 O: Thirdly, some demographic itiformaiion 
iiq for Blue Cross claimants from 1992 to 1998? 

114] A; Yes. 

[151 Q; Newspaper anicics containing statements 
(161 made by the tobacco industry; is that correct? 

[i:n A: Yes. 

[lai Q: And finally, a fax reproduction of 

[191 demonstrative exhibits that Professor Viscusi used 

poi in the Falise trial? 
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A: Yes. And you left out the 


PM 


pTi irttertogatives. 


P3I □; And finally what you described as 
PM interrogatives. 1 want to ask you little bit more 
psi what you mean by inicrrogaiivcs. 


<71 

ro 

-P' 

Ci3 

CJI 

■(5 

c» 

CD 
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2—09 50 25 25—09:51:33 
( 1 ) Krosnicit 

PI Do you mean inicmogaiorics? 
p) A; I could very well mean ihat 
f4] MR, HEFTER: 1 think that 's what he 


Pago 291 


(it means. Peter 

iq Q: Are these interrogatories which arc 
P) q^^stioriVor inierrogaiory answers or both? 
m VA: tell you. It's a document 

la ih^^^^obably at least 50 pages long and 1 
tioi quickly t^ned to the middle of it where h. began 
criptions of incidents in which tobacco 
try employees made public statements either at 
Terences or in media ^ji^cragc and 1 just 
3nion of it. . 

^his information info^^^on that 

the dcf^rtlanis^lp this case 
pn Of infomtjlpon that was being provScc^y the 
this ease? 

^^n'e know for sure. 
i^^TER; Peter, to move 
pi| we can stipulate that it was ouri 
laai to ycfit^tenogatoncs 68 and 
M^^i^LEY: Thank you 
Qf fcls»y, said^^pu ha 

Is that you 



PH pi 
(’•I 
[201 





Arosi 

owm.What arc thosi 
Ar^^^j^^bout a dozen books 
w bctw^^i ^99 and 2000 relevant 

(S) induki^ 

n Q:4^n^u describe them 

m A; of these arc academic book^somc 

(■I are v^M^iu might call more pt^^l^^^^css books. 

M trvicasjjd^hc history of years 

\Qi of tobacco compa^^^®®^ 
ugive us a couple t^^jies? 

k I recall might hive bccnVallcd 
by Joe Camel is Still Smiling. “ Another 
avc been called “The Tobacco Wars," but 
id^l won't temember more titles or authors 

|ing else? 

Anything else he can 

19) recall.' 

MR. BLEAKLEY: I am only asking what 
>i| he can recall. 

? 2 l MR. HEFTER: I understand that It 
!3i got lost in the translation. 

M| O; Anything else you reviewed on your own 
?s| that is not as the result of being provided them by 



2—09 53:08 


25—09:54 35 
Krosnick 
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[ 2 ) Dewey Ballaminc since February 12, 

IS| A; Yes I have examined data from the 1 998 
PI national health interview survey done by the 
isi Centers for Disease Control. National Center for 
ifii Health Statistics. 

m l am sorry, can J hear the question one 
iai mote lime? 

is| Q: Yes. What lam asking you is to 
(101 identify for us all of the materials that you have 
(111 reviewed since February I2ih.sincc your last 
[121 dcpiosiiion, on your own.That is not materials 
[13! that were provided to you by Dewey BaJIaniinc. 

[«) A; 1 am not remembeting anything else at 
|is( the moment. 

( 1 *! Q; Anything other work you have done since 
(in February 12lh? 

(i*) A; Thank you. I just remembered two 

|iq additional documents 1 have not mentioned that i 

tirej looked at. 

1211 These were reports submitted by two 

122 ) experts with regard to the depositions. One is by 

123) a gentleman whose name I believe is Dr. Semcnik. 

p4l The second one is a report provided by someone who 
{251 1 believe is a historian whose name I do not_ 
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2—09:54:39 


|i| 

121 remember. 
PI 
PI 

|5| 


25—09:55:45 

Krosnick 
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Q: PcBacco Cphonetic)? 

A: That could be it, yes. 

Q; Were those provided to you by Dewey 


iGi Ballantine? 

(7) A; Yes, they were. 

(■I Qr Can you think of anything else that you 
(ei were provided and that you have reviewed that was 
110 ) provided by Dewey Ballantine or which you got on 
(111 your own or with the help of a research assistant 
P 21 or anyone else? 

(131 A; I am not remembering anything else at 
|ui the moment. 

(151 Q; And you think that you have spent 
PH between 25 and 30 hours on these materials; is that 
(171 right? 

(181 A; Yes. 

(191 Q: liocs that include the approximately five 
ptj) hours that you met yesterday with counsel for 
PM plainiifP 

(221 A: No. 

(231 Q; So it's 30 hours, 25 to 30 hours 

I 2 *l reviewing materials and another five hours or so 

| 25 | preparing for this deposition yesterday and this 
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25—09 57 SO 

Krosnick 
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PI morning? 

( 3 I A: li could be. boi 1 want to tie clear. 1 

Kl don't have a vivid sense of how many hours 1 have 

isi spent. 

Id Q: Let me ask you a couple of general 
^quest^ns before asking you some specific questions 
kj^w^hese materials you have reviewed. 

the result of your review of these 
T^materals since February 1 2, have you developed any 
inions that you intend to offer in this case 
is a re.sult thereof? 

'«• N. 

^i'hat arc they? 

A?» have done a numbcipSPCxa 
t allow me a basis f^joffe^ 
fy] that ^ SRBl data reponed|irni|iy 
arc representative o; 

Si^^^pulaiions within the 
l^^^^^rariabtcs examined in 
pii I have also reviewed 
r?7i | 9 Si^ the basis for offering t 
I23l iffi^^lduals who filed cla 
pg&i l998aud.whov 
psi poi^^Juals wh^^^q clai 




nations of 
ig the opinion 
tten report 


terms of the 
sis. 

|at gjve 
^ opinic^ that 




jlue Cross-Blue Shiet 
iirs and I have formed 
sponsc rate in gaihcnn^ 
ase was very small am 
iiat provide a basis foj 



e Cross-Blue 
mokers resemble 
n 1992 and 1997 
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were ever 
ppiSiion that the 
repositions for 
leen materials 
ffeting an opinion 


rthc statements made'by tobaeco companies to 


1*1 public and pi^ 


Fthrough the news 


with more detail than I was ^blc to 
revf^usly. 

^BLEAKLEY: Would that back, 




read.) 

[Mj am able to offer an opinion now about 

[>5i ^e representativeness of the SRBI sample in a way 

[IS] ^^P^was not previously able to. 

[IT] ^^itelicve that's all. 

[Id you develop ihe.se — as I counted 

|is| It. there were five opinions at the request of 
I 2 ni counsel for the plaintiffs in this ca.se? 

[7i| A: No, 1 did not. 

[221 O: Vou developed these on your own’ 

[231 A: Yes. I did. 

[24] Q; All right. Let’s take them one by one. 

[251 Surting with the last one, 1 believe 


2—10 00:39 25 —10 01:59 Page 297 

(I] Krosnick 

( 2 ; what you said is that you were able to develop an 
[3i opinion about the representativeness of your SRBI 
HI .sample in a way that you could not previously do 
is) so. Would you explain for us how you were able to 
16 ) reach this opinion, which of the materials you have 
m reviewed since February 12. 2001 that made that 

[6] possible’ 

[91 A: During my last deposition, the first 
110 ] deposition, a question svas asked about whether 1 
MII had done any analysis to compare Che composition of 

[ 12 ] the SRBI sample to the country as a whole to assess 

[13] its representativeness, and at the time I answered 
[i4| that that was not possible, because that sort of 

|isi analysis is typically done by comparing the survey 
l<6| results with census bureau data that ate routinely 
|i7i taken to indicate with very high accuracy the 
■ III demographic characteristics of the country as a 
iisi whole, and I explained that is not possible for 
1201 this survey because we did not collect demographic 
I 2 i| information from all of the respondents. Wc only 
| 22 | callccTcd demographic information from people who 
I23| reproned they were currently or were former 
I24| cigarette smokers. 

1251 in the interest of addressing this 

2—10:02:00 25—10:03:22 Page 296 

|i| Krosnick 

[21 issue. 1 decided to use an approximation approach 
PI to it that I have hot seen done routinely before. 

HI That involved finding an alternative high quality 
I5i federal government survey that identified current 
(61 and former smokers done recently, mcasuied their 

[7] demographic characteristics, and then generated 
|6| [hose figures to compare with the demographic 
|9| characteristics of current and former smokers in 

|ioi the SRBI data set. 

[Ill O: 1 am afraid I don't understand how that 
172] makes it possible for you to teach the opinion that 
|i3| it was representative when at your deposition on 
114) February 1 2, you were unable to do so. You are 
jiis) going to have to explain that a little more to me. 

{iGj A: As 1 said, the standard approach to 
[17] assessing representativeness in terms of 
|7B| derrtognphic characteristics would be to compare 
119) census bureau data. But we don't have census 
[201 bureau data available that I am aware of that 
pt] identify current and former smokers and that allow 
122 ] for that analysis, so what I am doing is to use an 
I23j alternative approach that you might call 
124] triangulation. that's a term that we often use. 

IBS! where you use multiple methods to try to measure 
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11J Krosnick 

PI the same thing and the more agreement between those 
131 rhultiple methods, the more con/idcncc you have in 
Ml the validity of measurements from any one of them. 

[Si In this case 1 analyzed national health 
IS) interview survey data Now, this is a survey with 
PI i^re th^ 300,000 interviews done during 1998, so 
m sample size,The response rate for 

w ih^^wvcy is about 73 percent, and so 73 percent 
[iq i^oi 100 percent and that, therefore, makes it 
>m some census bureau data that we 
n look at where the response rate is closer to 
nf, but in this ease, I t^tmsideted this a 
set of data using a diffe^^l^^ptoach 
the dcmogiaphic ci^racteristics of 
former smokers, tht^fore, I 

c correspondence <|f tW"SR 
, and seeing that cor 
licence in the represent; 
d let me be clear tha^ 

21 ) deposition, 1 did express confid; 

221 rcprjBSj^nutivcncss of the sampli 
z»i nc’ 

2*1 judi 

251 Q lestimo at in 




i^add to my earlier 




5—10; 

ffrosj 

you expressed conhj 
itivencss of the sample 
cs. 

Iso said that one of t 
lai you were able to tjriwlop^since 
2 wasxhat the SRBI data wrr^— or the 
was representative \ 
ions. What subpopul; 
five of? 

broken the SRIW dah 
rst, I have just in the interest i 
rbitrary comparison, isolated 
who live in the nonheast region and 
14] the region of the U.S. combined and 

m com^P^^hat group to individuals living in the 
It] soutl^^S^est regions of the country combined in 
1*1 an crtoflbilBsBAnlore the reliability of the results 
1*1 in the sense where reliability means replicability. 

are the results the same when we examine two 
■'I subgroups in the population where there is no 
'll strong theoretical basis in advance for expecting 
131 them to differ and found that the two .subgroups 
■*) resemble each other quite closely in terms of their 
■SI perceptions of relative risks and in terms of the 


Paga 300 


2—10:06:03 25—10 07:17 Pags 3oi 

MJ Krosnick 

PI impact of OUT manipulation, exposing people to 
PI quotes by the Surgeon General and tobacco industry 
HI employees. 

(S| I also did an analysis where ! isolated 
i*; respondents who live in the northea.st region and 
PI are current Blue Cross-Blue Shield subscribers, 
m That group gets about as close as those survey data 
PI permit to identifying individuals who resemble 
{101 Empire Blue Cross-Blue Shield subscribers, and I 
|i<l found that the distributions of the key variables 
I 12 I in my analysis, the perceptions of relative risk 
and the smoking regret and desire to quit scale 
li<l look very, very comparable in that subgroup to the 
full sample and to the two regions. 

|is) Q; What is the new material that you have 
1171 reviewed since February 12 that made it possible 
lies for you to reach this conclusion? 

Ii*t A: New statistical analyses that I 
1201 conducted 

I 2 i| Q; What new statistical analyses that you 
1221 conducted? 

P-»l 
1251 


A; The ones I just described 
Q: Have they been produced to us’ 
A: 1 don't believe so. no. 


i 2 i son 
t*i indivl 


2—10 07:21 2&—10:08 08 

|i| Krosnick 

[21 H£Q MR. BLEAKLEYiWe want them. 

Pi MR. HEFTER: 1 will take it under 
HI advisement. 

[SI MR. 8LEAKLEY: Under advisement? We 
iei want them before this morning. I would like 
[7] them totlay. 1 would like them so we can use 
PI them in this deposition.They should have 
n been provided to us before today.The 
[101 notice of this deposition had attached to it 
l<n a schedule of documents that is the standard 
1121 form of schedule of documents that is 
<131 attached to every deposition notice for 
|i*l every expert that's been in this case, and 
lisi as far as we're concerned, you had an 
(<i*l obligation to look at that and to obtain and 
jii7i provide to us in advance of this deposition 
111*1 anything that forms the basis for opinions 
i[i9i that he’s going to express at trial 
|iao] We are going to want lo take hi.s 
ipil deposition again before he testifies if 
|[221 there are — if actually there is a document 
[231 here or if there are any other analyses of 
121 ) this kind. 

ITS) 1 just want to put that on the record 
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at 10:10 this morning so ihai you can send 
somebody out to get that stUlT right HOW, 
A; If it's useful, these were done last 


Pa9e303 




.A 

! 3 ) 

HI 

1 S| night 

161 MR. WILLIAMS: Then he must have them. 
m MR. HEFTER; Why don't we take a break 
i<; and we can talk about it, if that's what you 
would like to do. 

MR. BLEAKLEY; What I want to know is 
how much more of this I am going to find. 
We can go off the record 
MR. WILLIAMS: No, I want this on the 
record. I want to kr»w hovy much else they 

MR. BLEAKLEY: off the record 

|i?) and then we will pu^ ihc record. 

THE VIOEOGRAPHEMThE time is 10:09 


rr». and we arc goii 
(Recess taken ■) 
THE VIDEOGRAPHj 
m. and we are back 


Q: Before the brea 
ng you aJb^t the 



10 t4.5 




record, 

eitime is 1015 
cord. 

EAKLEY: 
nick, 1 was 
Sion that you say you 





10:16:37 
lie* 

cntativcncss of 
B1 dau.What 
about? 


described ■ 


in.71 
again.Tell me 


living in 

a combination of 
Muih and west 


arc acuc'wi iptMTafKiut tl 
ions subpopulations^ 
ipopulations are we u 
^MR. HEFTER: Objcciio. 

: The subpopulacioi 
l^t 1 described to you cj 

Would you describe them 
logizc for asking you 
they arc. 

A combination oftlti 
.onheast and midwe 
dividuals living in th 

ns and individuals living in the nonheast 
who arc current Blue Cross-Blue Shield 
fibers or, excuse me, who were current Blue 
luc Shield subscribers at the time of the 

i i^your opinion that the SRBI survey 

niativc of the population of Empire Blue 
('ross subscribers who filed claims in 1998? 

A; With regard to the variables that arc 
the focus of my analyses, I have looked for but 
have nt>t yet found any evidence to challenge the 
idea that the panerns observed in the full 



2—10 16:40 


2S—10 18:00 
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IT] national sample are replicated in various subgroups 
oi of the pxjpulation. In, forcjcampte. the ones I 
l<) just mentioned as welt as tny original written 
isi report, I compared Blue Cross-Blue Shield 
l6i subscribers from across the country to individuals 
(7| who had never been Blue Cross-Blue Shield 
|8) subscribers The more such analyses that I do. the 
PI more convinced I become that the patterns that are 
MG| the focus of my analysis generalize across many 
Mt| subgroupis in the population, and that gives me 
| 12 I greater confidence that chose same patterns are 
im present in 1998 claim filers to Empire Blue 
ii-i| Cross-Blue Shield who are current or former 
jisi smokers 

(ifl Q; 'You said that one of the new opinions 
[17) that you have been able to develop is that Empire 
iii»i Blue Cross subscribers who filed claims in 1998. 

||i») and I believe the word you used was resemble those 
TO who filed between 1992 and 199'?. Would you explain 
pt) to us how you came to that opinion? 

PJ) A: Yes. 

TO Q: And the materials that you reviewed upon 
p4| which you tely in developing chat opinion. 


Pa9« 304 




A: I can't describe for you in detail 
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PI exactly what the documents arc, but 1 have seen 
C3i documents that I expect to obtain copies of in the 
HI near future that provide sutistical descriptions 
IS) of the gender balance and age balance of 
Id individuals who filed claifns with Empire each year 
P! between 1992 and 1998. 

(8) Q: What do you mean when you say you have 
la seen and expect to be able to obtain copies by the 
( 10 ) lime you testify? What is it you have seen and how 
jii ii do you expect to be able to obtain copte.st 
A: I saw them. 

Q: Where? 

A: They were handed to me. 

Q; By whom? 

A; By Uewey Batlantinc lawyers. 

Q: When? 

A: Yesterday. 

Q: What were they? 

A: As I say, all I can tell you i.s they 
pil were pieces of paper that described what 1 listed 
TO for you I can't tell you details other than that 
;TO my understanding is they come from data from 
iiM) Empire's statistical files themselves on claims 
I (751 REQ MR, BLEAKLEY: We wa nt these, too. 


i(l7) 

rm 

I>S( 

ftn 

[ 10 ] 

(JOi 
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MR. HEFTER; Wc will provide vhosc lo 
Bl you Some of them you already have. 

(•I A; I am not sure I completely answered that 
IS) question, 

l»j You wanted to know what you mean by — 

[7] w^n 1 expected to receive them in the future. My 
m is they arc being Xeroxed for me to 

I9| hay^raipy of. so I just simply haven't gonen 
, but i expect to. 

SAKLEY: Just^so there is no open 
I this, this man is still 
; opinions based on i^a^^rials you 
^ng him yesterday and we 

I want his depositiot^gain 
^stifles in this ease, 

'MR. HEIP'ER: You will have I 
}und lunchtime, you \ 

^icn.You will be have i 
toi tiiyie'Tiy'ltSi^ at it and — I 

til MR. BLEAKLEY: 1 am not obl| 

12 ) prepire^r a deposition in the i 
m just alerting yov 

M) fact tj^^^e warn am^gg^erials j 
>s) rcadi^^M reviewi&g^u^ the 1 
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Arosritci 

ioi^to testify or develop 

h he is going to testify^ 
want to take his dec 
that happens. 

EH; We will have 
when we come to it.; 
is demographic dab 
rsand nonsmokers, 
rs and nonsmokers, I 


include data for fornicr smokers? 
c so, yes. 

aggregated or segregated for 
nsmokers and former smokers? 
e it is not segregated for those 

opinion that you said you have 
i| been able to develop since February 12 is that the 
1 nonresponse rate in the deposition survey was very 
<1 small. 

■t Would you explain to us how you came to 
q that opinion and the basis for it and whatever 
ij materials you reviewed in coming to that opinion? 
q A; I received an e-mail late last night 
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PI from Jason Harman listing for me the details of all 

[3] individuals who were selected to be deposed but 
HI uliimaicly were not deposed as a part of that 
I5i exercise and, lam sorry, what was the rest of the 
|S) question? 

m Q: 1 wanted you to describe the basis for 
IB| the opinion and whatever you have reviewed that 
I9i allows you to come to that opinion. 
iioi A: 1 have fully answered yourquestion 
|ii| Q: So the basis for the opinion is what you 
ii 2 ) received in this e-mail? 

(13) A:: Yes. 

1)41 Q: And you are relying on that? 
nsj A: Yes. 

[ 16 ] REQ MR. BLEAKLEY; Wc want that. too. 

[17) MR. HEFTER: You can have it at 

[isi lunchtime. He also said that you have the 
[191 same available, information available lo you 
[TDI as well. 

[ 2 il MR. BLEAKLEY: I don't have available 
(221 to me what he relied on. U may be buried 
[23i in other materials, but what wc arc entitled 
[ 2 <l to is what he relied on. 

[25) MR. HEFTER: As I said, you can have 

2—10:22 05 25—10.22:51 Pag«310 
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[21 it at lunchtime. 

PI Q: Do you know whether this is the number 
HI of people that the survey organization tried to 
IS) call? Is that what you arc talking about here? 

15] A; No. it is not. 

PI Q: Docs it include the number of — you 
PI know this was done by Audics & Surveys? 
m A: Yes, 1 do 

( 10 ) Q: And you know they made calls to pieople? 

(iij A: Yes,Ido. 

|i 2 ) Q: When you talk about the nonresponse 
(131 rate, you arc including in the nonresponse rate the 
|i4| people that Audits & Surveys called who did not 
(isi take the calls? 

|)6[ A: No, 1 am not. 

[171 Q: Are you including people who Audits & 
ii»] Surveys called but who hung up on them after they 
|i9) made the call? 

( 20 ) A: No.To be clear. I said it is people 

[211 who were selected to be deposed but ultimately were 

( 22 ) not. 

(23) Q: Do you know whether the material — have 

(24) you seen any material or arc you relying on any 

(25) information that tells you the number of people who 
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1 were tlisqualUicd from chc exercise by virtue of 
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I’ 


2—10:25:46 


«! 
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L twine? dim 1 iinrl^rer^inH . 


(he fact they were noi smokers? 

A; 1 am not sure at what stage you mean — 

Q: At any stage. 

A: I do — yes, I have seen numbers on. 
in^^ating that a very smalt number of individuals 
wl;^ were selected to be deposed turned out not to 
smokers and therefore were not deposed. 

Q: Do you know what pcrcenugc of people 
were called informed the caller that they were 
never smokers? 

Called by whom? 

Audits & Surveys 
No. 

So any such people 
ic would not be inci 
is that right? 

; Yes Just to be clear, I 

1 have a nonrespon; 
with which to make ju 
that particular stage of th 
t me make sure I 
you a^^^ng is 
sponsc ^c^at yo 





th«?'^mbcr of such 
dC^'in Vour nonresponse 


aw information 
3ut nonresponse at 






rid, then. 


I be adequate — 


'4 12 


kt right, or the respofiBftfo^aafia^ou found to 
licquatc; is that right?*^^^^ 

1 don't know whelhcr^^^f'the word 
|uaic or not earlier, 
j What did you mcan^,,,,.,., 

^ I think i said that the numbeifeof 



: deposed but 


l’?l 
I'll, 
i'*i 
I'Si 
i>«i 
I'h, 
('«i 
f'»t 
i»i 
iri| 
i?5n 
|J3| 
p*i 


arise or 
got customary 
3 called but not 


[iduals who were dig 
d to do so was very Ismail 
^ Okay When calculatf^^^ 
rsponse rate in a stir 
lude tho.se people ’ 
tied? 

i. HEFTER: Objection. 

1 am not sure what you mean by 
rted." 

a person was called and [hey either 
Jto talk, hung up after a few minutes, or 
^said^hey were nonsmokcrs. Audits & Surveys called 
them on the telephone and one of those three things 
occurred, arc those people cusiomarily in a survey 
included in the nonresponse rate? 

MR. HEFTER; Objcciion to the form of 

the que.stion. 

A; So arc we — i gues-s I am having trouble 


PI 

HI 

IS? 

I«1 

PI 

I®! 

Pt 

1101 

l"l 

I'OI 

l«l 

115] 

[1«| 

im 

|[1S1 

P0| 

pll 

PJl 

P31 

l»l 
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I>1 

PI 

PI 

HI 

|i| 

IS| 

PI 

m 

m 

I'OI 

it'i 

I'ai 

I'Oi 

||S| 

['SI 

('«! 

fh 

|I8| 

(l»l 

pel 

P'l 

|23| 

P'l 

1»1 


which survey? Is it the Audits & Surveys — 

Q: The deposition survey, the first step of 
which was conducted by Audits & Surveys. 

A; Okay. Audits A Surveys did telephone 
calling I don't have the complete details on what 
they did, but my understanding of what they did 
approximates a survey procedure in some ways. 1# 
you are asking me if 1 am going to generate a 
response rate for that survey, if people refuse to 
talk, [hey would certainly be counted as 
nonrespondents. 

Q: Do you know liiat for a fact? 

A: I am saying, in normal procedure, we 
would count them as nonrespondenis. 

O; Do you know, in fact, whether that was 
done here? 

MR. HEFTER: Objection. 

A: By whom? 

Q: Audits & Surveys. 

A; If it was counted as pan of a 
notirespofise rate? 

Q: Yes 

A: I don't know, 1 have not seen any 

2—10:26 58 25—10:28 07 Page 314 
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information on the nonresponse rate for Audits & 

Surveys, so — 

Q'- Let me try to get at this a different 
way. 

As I understand it, the new opinion that 
you were able to develop is that the nonresponse 
rate in the deposition survey was very small; is 
that right? 

A: No. 

Q: Then you tell tnc, what is the new 
opinion that you have been able to develop with 
respect to the response rate, the nonrcspionse tatc 
and the deposition survey. 

A: As 1 hope I said earlier, the new 
opinion is that a very small number of respondents 
who were selected to be deposed refused to do so. 

Q; What is the significance, if any, of 
that fact or that finding to your opinions in this 
case? 

A: If that number had been large, then that 
would raise the possibility that an oveiall 
calculation of a response rate for the depositions, 
as compared to its population, might be 
significantly less than 90 percent, but in this 
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Rl case, because that figure was smaller than 10 
PI percent, it does not indicate that. 
ii| Q: What is ihe significance of the fact 
IS] that a response rate is less than 90 percent in 
iEi surveys? 

P) It h'Ste no special significance. It s 
{■I ji^t it w^ld be a way to describe the response 
|9| rai^^^ 

: If thf response rate is too low, does 

ing into question the validity of the 

ER: Objection 
if all. we would have. [I 
I can answer your 

Theresa growing body of 

, brand new aaicle edition 

!^^inion Quarterly, shoj 
|lte for a survey acmaffy 
ail the validity and generalizabiliiy j 
221 So, ii^iaj^r words, in comparis 
231 surve^^^t^igh response raiel 
Ml with respons^g^M. the r 

2 S) desc4^^% the po^^j^n app 







5—10 
' Krosi 

;sed by those lower 
pears at the moment l 
ctaturc suggests that 
o the validity of the 

ur opinion that tes| 

K irrele^Si^i deicrmining the vali 
In t say that it's irrcle 
aying is that a lower re^S^^tatc does 
r Itself indicate lo and, 
l^t of new studies that's been' 

I our htetature indicates that low 
Sc surveys so fiir have not been shown to 
amUlly any more unrepresentative of the 
than higher response rate surveys. 

I asking for your opinion. I 
^ion. 

A: That is rrty opinion. 

O: Vour opinion is chaT a iow response race 

It docs not affect the validity of a survey, is that 
21 right? 

Ji A; We would have to define low, of course. 

•I bui, again, just to be clear. 1 do not judge the 
validity of the data personally, in my opinion. 
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based upon the response rate for the survey for the 

reason I just outlined 

Q; A moment ago you said that you wouldn't 
describe it as irreievant. When does it become 
relevant? 

A: It'S relevant to describing the 
ptot:cdures implemented. 

Q; Why? 

A: In other words, in all survey research, 
we always want lo provide to people who might make 
use of the dau or interpret the data, all facts 
about the procedures by which those data were 
collected. 

Q: Why is the response tatc relevant? 

MR, HEFTER: Objeaion. 

A: As 1 say, it’s one figure that provides 
information to people about how the survey was 
conducted. 

Q: Why arc people interested in that 
information? 

MR. HEFTER; Objection. 

A: I am not sure if I should speak for why 
other people are interested in the information. I 
am not sure I could do a go od job of that, but it’s _ 
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indication of the process by which the data were 
collected, and professionals arc interested in all 
the details about the process. 

Q: Is there a response fate in surveys that 
is regarded as conventional or customary? 

MR. HEFTER: Objection 

Q: Desirable resfionsc tatc. 

A: Desirable? I guess 1 would say no, 
there is no panicular response rate that is 
desirable in surveys. 

Q: So if I were to say to you that it is 
customary or conventional for a person conducting a 
survey to have at least 90 percent rcspionsc rate, 
you would say I was wrong? 

A: 1 am sorry, could you say that again or 
just repeat it back just so I get ii? 

Q: Well, I will ask the question 
differently. 

Isn'i. in fact.a 90 percent response 
rate regarded as conveniional of customary by 
people doing survey research? 

MR. HEFTER; Objection. 

A: By conventional or customary, do you 
mean common? 
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Q; Let's start with common. 

A; Okay. 

Q: Would you — 

A: A response rate in that area is common 
foe surveys done by the federal government. It is 
PI not^ommon for surveys done by anybody else. 

In your view, does a response rate of 
i than 90 percent compromise the validity of the 
^cy? 

No. 

I: In your view, does it make absolutely no 



trence what the resp 
In my view, I have 
[IS) to indicate that reduced 
^^lidity of data. 

(iri What if the respon: 
ne thing? 

fc Yes. I have pubtishe 
surtcys with response ra 
10 percent arc actually rr 
vcys with higher rcsi 

hy are they more% 
In that D^g^ilar 
eifle arH!8«!e^ and if 

3:34 


. ‘S? 

cn evidence 

Sptonsc rate compromises 









0 percent? 


towing that 
g neighborhood of 
ale than some 

it??' 

arc a lot 
to do with the 
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k 

survey was put. 




cn the 
may be 

tcs between the 
lo don’t respond? 

I low is, but 


frosm 

^cular application to 
^n't give you a genera! ara 
Isn't there a danger 
tnse rate is too low 
ortant demographic 
^plc who respond and^thosc 
1. HEFTER: Objcctio 
Again, 1 don't know 

^ower the response r^e^lliSDS^related to the 
^graphic reprcscniai^l^^J^f the sample, so 
we have seen, and fhe reason for it is that 
no^esponse in surveys, we are now coming to 
Agnize, comes from attributes of individuals 
safe specific to the resptonse process but 
Scally unrelated to the variables that we 
sure. 

ct me ask it a different way. 

1191 In a survey that is going to ask the 
Roi kinds of questions that the deposition survey in 
pi| this ease asked, isn’t there a danger that there’s 
P 21 a difference between the people who refused to 
1211 panicipaic and those who don't? 

( 2*1 MR. HEFTER; Objection. 

I 2 S| A; There is a possibility that there is a 
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difference between tho.se two groups, and the 
smaller the group of individuals who arc 
interviewed, the less impact that difference would 
have on the ovcrali results if they had been 
interviewed. 

Q; And conversely, the latter that 
percentage is, the more opponuniiy there is for 
there to be such a difference, right? 

A: The more opportunity there is. but as 1 
say. our literature so far indicates that in all of 
the tests done of it, chat that does not, in fact, 
exacerbate nonrcprcscntativcncss notably. 

Q; The fifth of the opinions that you said 
that you had been able to develop since February 12 
as a result of reviewing materials were that you 
were able to develop an opinion — if I am not 
stating this. I want you to correct it and state it 
in your language — state ments made by the tobacco 
industry to the American public with more detail 
than you were able to previously. 

What opinions were you able to express 
about statements made by the tobacco industry to 
the American public before? 

A: It was my opinion at that ti me that _ 
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tobacco companies did not. on a regular basis, make 
statements that Americans were exposed to in brge 
numbers, indicating that the tobacco companies 
believed cigarette smoking causes serious health 

problems until very recently. 

Q; What is the opinion that you have now? 

A; I continue to hold that opinion, but I 
have now a more detailed basis for, in addition to 
that opinion, which is that tobacco companies' 
executives or employees made statements on a 
regular basis between the 1950s and the 1980s that 
were publicized by chc national news media 
indicating that the scientific evidence on the 
health effects of smoking did not document a 
connection between smoking and serious health 
problems. 

Q: This is an opinion that you have 
developed since February 12th? 

A: As I mentioned, it is in greater detail 
now than I had previously. 

Q: Your testimony is that at your prior 

deposition, you icsiilicd that the tobacco industry 
made siatcmcnis to the American people about 
smoking and health and that you now have more of 


cn 
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Ol 
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PI ihat. Is (hat right? 


A; Yes. 

Q; 'What are the materials upon which you 


w 

isi rely for this opinion that you have reviewed since 
n i^ruaq^l2th? 


PI 

m ih 


( A: Newspaper anicles and your re.sponse to 


-Dorics, is that the right term, which 






H i^ludes a listing of newspaper articles 

f bLEAKLEY;Wc want the newspaper 

ER; We will get you newspaper 

EAKLEY: Once again,; 

(tg gipin^o want to take his depo: 
iR to want to rcscrvi 

IT) lake bis ^position again, beca 
th new Opinion that 
ed this morning,all 
ed in whole or in part upon 
that were provided to him and 
22 ) has that he retied ii 

2 S iho^^piniWis.We are going to^wa 
a*l dcpggi^^ again. 

f ER: Lct^gje^ that feptee _ 
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omc to it. Let me al: 
that you have characterit 
nions.That is your 
ition. 

AKLEY; No.that’s wl^tT^ic^ 
lat's what he said. I asL^Ajm^ 
eloped any new opiira^^m those 
he listed Eve. 

be clear. 1 am using ppimon Jn 

not necessarily ^^P^^^ninology. 
t sure what the legal dehniiion of 
you would like me to be more 
t to clarify whether, when 1 say five new 
t conforms to what the legal 
is, lam delighted to do it. 
it'^u^ testimony that this opinion, 

that we have just been discussing, 

Bl that statcmcnis were made by the tobacco industry 
ci to Che American public, that these siatcmcnis were, 
ti in hict. seen and heard by a substantial segment of 
zi the American public? 

3| A: Yes. 

4\ Q: What is the basis for that? 

B\ A: It is the fact that they were published 
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in outlets such as The New York Times and The 
Washington Post, which arc very widely read by 
people. 

Q; Anything else? Any other basis for 
concluding chat these were — that these were shown 
and seen and heard by a substantial segment of the 
American population? 

A; No. 

Q: Is it your ccscimony that a substantia] 
segnnem of the American population relied upon 
these statemenrs by the tobacco industry^ 

MR. HEFTER: Objection. 

A: Can 1 ask for clarification about what 
docs relied upon mean? 

Q: Do you have an opinkin as to whether 
they were relied? 

A: I am just asking for a clarification of 
what docs retied mean. 

Q; If you can't answer the question, say "I 
ctin't answer the question ~ 

A: 1 might be able to answer the question 
if I understood it completely. 1 think retied has 
a particular legal meaning and I fust — I would 
like to understand what h is so 1 can be sure I 
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can answer. 

Q: Does it have a meaning to you other than 
a legal meaning? 

A: To me. the word "relied on" or the 
phrase ‘relied on* means used in some way, but I 
have a feehng that that term has a more specific 
legal definition. 1 lust want to be careful. 

Q: Do you have an opinion as to whether or 
not a substantial segment of the American 
population relied upon these statements in these 
documents we haven't seen to make decisions about 
whether to smoke, continue to smoke or take up 
smoking? 

MR. HEFTEH: Object to the form of the 
que.stioti 

A: Would you like me to use my own 
definition of that term meaning "used in some way"? 

Q; Answer h the best way you can. 

A: All right. I will use that definition. 

Yes, I do have an opinion. 

Q; What is that opinion? 

A: My opinion is that people who were 
exposed to that information most likely were 
influenced by it in the process by which they did 


•age 323 - Page 326 (14) 


MJn-U-Script(» SPHERION DEPOSITION SERVICES 


http://legacy.library.ucsf.ed ffi'dicl/afqQ^pQO/pdfvv.industrydocuments.ucsf.edu/docs/ryhl0001 


52434 5497 





AJE caioss AND Bi-UE SHI EID 
HIUP MORRIS 


JON A- KROSNICK 
March 12, 2001 


2—10 43:40 25—10 45 11 Page 327 

Krosnick 

or JiO not smoke ci^rcttcs. 

Q: What is the basis for that opinion? 

A: The basis for that opinion is, number 
one. as 1 cxpresseO a moment ago, the likely 
widespread exposure to that information that will 
rcs^t from anything prominently published in 
ely circulated national newspapers, and 
ccondly. the fact that the ongoing debate in the 
rttry over that time period about the health 
tts of smoking I think made many people 
attcjptive to that question and attctiiive to 
ation provided. Kv i 
1y own research frotfl^^^il survey 
indiizates that siatemcnis ^tobacco companies are 
|ntial of people’s de^ons'^iout smoking and 
tha^flso figures as a basi4forThatjopinion 
Are you talking aboi 
index? 

^ Well, the experimerj do: 
index, yes- 

Q; Anything else? 



tivation to 


ith that 



any 
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; Statistical analyses? 

■Yes. 

|Yes, as I have already 
The one that you ditr 
jing to get during th^s+««ebsbrcak? 

bsssssssssJ 

1 Any other than that?^^^^^ 

te obtaining the national 

interview survey. wbVi^|^u will also get 

' When you say we get, you 

^ we are going to get the national health survey 
ilcfe is some wrinen analysis of that survey 
su have done since February 12th? 

% wilt give you a printout of the 
|ic.s generated fnim iho.se data, 
i else? 

Ii9| A; I computed the reliability of the 
1201 motivation to quit index, which is also in this 
pil printout I will give you.and the correlations 
122 ) between the components of that index. 

[23| 1 believe that's all. 

I29J Q: And the computation of the reliability 
t 2 Si of the motivation to quit index and the 
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m correlations that you just dcscribcil will be 

|3) produced in written form? 

|a| A: They will be in this printout that I 
IS) will give you shortly. 

|6) Q: Have you provided any wiitlcn analyses, 

FT) mcinoranda. reports to counsel for Empire Blue Cross 
IS) since February 12th? 

PI A; No. 

uo) Q: Have you been asked to do any additional 
IM) wofk by Dewey Ballaniine before you testify at 
ti 2 ) trial? 
ri3j A: No. 

Its) Q: Is it your intention to do any 

115) additional work between now and the time you 

116 ) testify? 

[ 1 ?) A: Yes. 

[ 18 ) O: What work is that? 

(i9l A: I plan to lead all of the depositions 
t 2 c| taken in the case by that time. I plan to get 

121 ) additional information on the relative risk of lung 

122 ) cancer due to smoking. 

[ 21 ] O: Why? 

[;«) A: To supplement the information that 1 

I 2 S) have used already. 
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) 2 I Q: What do you mean, to supplement it? Why 
P) do you need to supplement it? 

)4) A: 1 would like to reinforce confidence in 
IS) key aspiccis of materials that I relied on. and 
|6) that's another place in which it would be useful, I 
t?) think, to do that, 
m Q: Okay. 

P) A: I plan to conduct a new analysis of the 
)ioi SRBl survey using a new weighting scheme. 

[••) Q: What does that mean? 

112 ) A: Well, 1 mentioned that 1 did a 
[ 13 ) comparison of the dctnogntphic characteristics of 
li4| the SRBl survey respondents to the demographic 
|is) chaiacTcristics of current and former smokers in 
[T«i the national health interview survey.There are 
[17) very small discrepancies between those two samples 
]i») which are consistent with the difference in 
ft9) methodology used lo collect the data; that is, the 
I 20 [ national health interview survey is a face-to-face 
1211 study, the SRBl is a telephone Study-Telephone 
| 22 | surveys are known to represem certain demographic 
123) groups slightly less frequently than face-to-face 
p*) surveys do, and so my intention is to replicate all 
| 2 S) of the analyses that 1 have done with the SRBl data 


SPHERION DEPOSITION SERVICES 


Mifi-U-Sciriptis> 


( 1 5) Page 327 - Page 330 


http://legacy.library.ucsf.edi:f!liflt/uyq07a00/(p^'fA/.industrydocuments.ucsf.edu/docs/ryhl0001 


52434 5498 




JOIV A. KROSNICK 

March 12, 2001 


BLIIE CROSS AND BLIJE SHIELD V. 

PHILIP MORKIS 


2—to 49:25 


25—10 51:00 

Krosnick 


Page 331 


t 2 i but this time weighting those data so that the 
[3| sample has demographic characteristics matching the 
HI national health interview surveys, demographic 
ist characteristics of current and former smokers just 
m tt^ec whether the results and conclusions drawn 
fT] f|am thcr^ alter when doing that. 

tn are you going to do that'* 
k; As soon as I have time, which would be 

L about a week and a half or two 



i trial? 


ing else that you pkw to do 
^ow and the time you’teSi^^^ 
to continue rcading^iSTOrtil 
rage of statements smoking and 

o,^rthcr bolster that se|of^'^isu^ in my 

let to get information dnX*"^ 
jrveys telephone cal 
»t smokers among the Blue Cross-1 
?i) subs^bers. 1 haven't seen that 
?ai Q: i ^te wcan you are going t< 

»i Batl^mne t^ive you th: 

24| A 


25) 


aisng 
at you ca? 

2—T 



' you: 
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Krosi 

nse taic is not a pi 
ER: Cybjcction 
as to gather infoi 
pf that clement of 
r no particular rcasoh’ | 

ER; Objection. 

r no particular reasoh, becau^ 1 
I may be asked to pip^^^^ormation 
Icmcnt of the proccK a jg I^ on't have 
'ormation yet about of 

fing else you are going to do 
jrThow and the time you testify at trial that 
^ith this case? 

; you. 

Ijchink of, 

DU agree with me that a survey 
g needs to be designed and conducted properly in 
0 ) order for it to be valid? 
il MR, HEFTER: Objection. 

2 ) A: It's hart! for me to answer in a couple 

3) of ways. Number one. we don't really have a set of 
4j guidelines that say. here is what a proper set of 

^ design decisions are and here is a set of improper 
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design decisions,and then wc also have to define 
valid in what regard. 

Q: Does the term ‘valid" mean anything to 
you in the context of survey research? 

A: Yes, it docs. 

Q: What docs it mean? 

A: Well, typically, the word “validity' is 
used to describe the accuracy wiih which a measure 
reflects the construct that it is designed to 
measure- 

Q: Would you agree with me that a survey 
needs to be designed and conducted properly in 
order for it to be valid, as you have just defined 
validity? 

A: As I defined validity, normally you 
wouldn't use validity to refer to a survey. You 
would use it to refer to an individual measure 
within that survey. 

Q: Let’s pot the question differently, 
then. 

Would you agree with me that a survey 
needs to be designed and conducted properly in 
order for it to be one on which people should rely? 

MR. HEFTER: Objection. _ _ 
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A; I can neither agree nor disagree. As i 
said, we don't have guidelines that say this is 
proper and this is improper. 

Q: So there is no standard, is that what 
you are saying — , 

MR. HEFTER: Objection. 

Q: — for a properly conducted, designed 
and conducted survey? 

A: Yes, there is no list of characteristics 
that a survey must have to be called proper, that 
is correct. 

Q: Survey research is a science, isn’t it? 

A : Yes. it is 

Q; And there arc lots of bad surveys out 
there, aren't there? 

A: 1 think wc would have to clarify bad in 
whai way. Some people might say bad in lerms of 
they don't like the results, others would say bad 
in terms of other aspects of them, so 1 would have 
to clarify with you what you mean there. 

Q; When you said there is no sundard, tio 
you mean that the survey research liierarure docs 

not talk about potcniial errors and mi.stakes in 
conducting and designing surveys? 
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A: The liicraiurc docs talk about potential 

errors and mistakes 

Q: In fact, you. yourself, have written 
extensively on the subject, haven't you? 

Yes 

Arc there ways to check or lo verify or 
sure that a survey is done, whatever icim you 
to use. proptcrly, correctly, in the best way 
lible? 

Now we can — now 1 can grab on to that, 
c best way possible. 

,rc there ways to dct4**5}i^c that? Yes, 
are. 


ling that one 

ied population and 
from that in a 
ment of the 
probability of 
e extensive 
selected sample 
nt to design a 
ordings that 
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What arc they? 

I’s a long list . The fi^set 'i 
cortl^crations would inv^ly 
Id want to begin wit 
uid want to draw a^ 
malic way whereby ^c: 
population has a known 
ection. One would wa 
.to gather data fro 
icnts as On 

ue^innnair^ygjjjg formaUc,S(nd 





zed the likelihood 
wnth which respondeffi 
brination of inicre 
iCUlous in recording, t$ 
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d maximize the 
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ould want to be 
ng and analyzing 
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data so as not to intpidoee^ny additional 
dental mistakes. J 

I hat's a pretty giws^wto 
'with. I am sure ibcrcsaw^l^^ 

Suppose you are de^^^^^survcy.Are 
ways to, after you b^^^^^ned a survey, to 
f nain whether or not frsa gotm survey or is 
to be a good survey? 

. HEFTER; Objection. 

^ 1 am having trouble with what a good 
y is, but — 

Do you do bad surveys? 

St have trouble describing surveys 
as good or had Surveys have features to them, and 
those features enhance or decrease the likelihood 
that the data obtained can be confidently used for 
certain types of irtfcrcnccs or judgments. 

Q: Well, let's use that definition. 

MR. 8LEAKLEV: May 1 have that back, 
please. 
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(?i (Record read.) 

PI Q: Suppose your goal is to enhance the 
HI possibility that the survey data can be used to 
[si make inferences,okay? What can you do when 
r«] designing and conducting a survey, to enhance those 
m possibilities? 

HI A: Well, it would depend completely on what 
191 inferences one would want to make, 
inn Q: Once you have designed such a survey, is 
[I i| there a process in the survey world for having it 
(izi checked by, to sec whether or not it is most likely 
jiai to produce that kind of result? 

[i4| A: What kind of result? 

[is) Q: One that enhances the possibilities that 
[ 1 KI you can draw the inferences from it. 

(17I A: Draw which inferences? 

(i»l Q: Whatever inferences.any inferences. 

I 1 BJ A: Any inferences, okay. 

{201 Q: You don't do survey research just for 
1211 the heck of it, do you? 

1221 A; Typically, you do it with the goal of 
iTJi making certain types of inferences, yes. 

I24| Q: Let’s, with the goal of making certain 
{251 types of inferences, let’s try to use that as the 
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( 2 l definition here of a good survey, 
ra MR. HEFTER: Objection. 

(4| A: 1 think we are going down a path which 
(S) is going to confuse us later. 

{Gi For example, you might have one of two 
m different goals in doing a survey. One would be — 

(81 1 will just use an arbittary example here — to 
(9) measure which presidential candidate the majority 
1101 of Americans prefer lo be elected president in the 
(It] next election.You might also want to do a survey, 

(121 in order to predict or forecast which candidate 
[loi will win that election. 

114] Those arc two different inferences that 
[iM you might want to make, and the way you would 
[ 1 KI design a survey to achieve those two inferences 
im would be very diffcienc in those two eases.To 
ii»l implement it in the way to optimize the likelihood 
[<«i of making the first inference would actually hurt 
(201 your ability to make the second inference, and vice 
pi| versa. So whenever we talk about features of a 
(221 survey that enhance ihc likelihood of making 
123) inferences and what designs would you want to sec 
1241 in a survey, you have to be sort of spiecific about 
[ZS 1 what those inferences would be. 
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PI Q: Fair enough. 

(31 Whai was the goal of ihc SRBl survey? 

W A: Well there, were a number of goals of 

(sj the SRBl survey. One goal was lo measure people's 

l«) perceptmns of the relative risk of smoking and 

[7) casing t^ig cancer A second goal of that survey 

m s^^^^|a$uFc the impact that hearing statements 

PI abom^mc relation of smoking to health by tobacco 

|io| c^Sj^S^'fiployecs has on current and former 

( 11 ] s^^^^^gret about smoking and desire to quit 

. 

| 1 Z) SI 

say those were the | 

there subsidiary goap 

^re were two goals. 

^e perception of the 
^ the survey respond' 

\ of survey responde 
pi) to measure the impact on those! 

IZ2I of stilements about smoking anj 

123] 

Q:,pS^'"dcsigip6^atkin. 
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review. You know wj 


IS| in doffi 
m I 
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something akin to 
rveys? 

icw is the process ii 
enerated by a researcher a; 
led to be competent 
>ns and suggestions 
n survey research, yt^s 
ur SRBl survey peci 
not been subjected to freer 

1 ^ rcvic 

he deposition survey peer :rcviewcd? 

^y, I should back off. I don't 
licr the SRBl study was peer reviewed or 
I know whether the deposition survey 
ved or not. 

HI Q: You don't know whether your own survey 
■o| was peer reviewed? 

•11 A: I am not aware of any instances in which 
71 that occurred, but that may have occurred without 
3| my knowledge. 

<] Q: Let me go back to the question I asked 
M before, which is the peer review process occurs 
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P) afterwards. What about before.? 

PI Someone is designing a survey and it’s a 
Ml survey the goal of which is lo measure people's 
isi perception of relative risk and measure the impact 
(«i of statements about smoking and health, is there a 
(7) way,a process, a convention in survey research for 
(SI finding out whether or not that survey,as 
(9) designed, makes sense? 
riDi A: Yes. 

[Ill Q: What is it, and tell us how you go about 
t'21 it. 

Ii3| A: The design of this particular survey is 
|i4] not particularly innovative. It is based upon — 

[151 pretty much all of the steps involved in it are 

1141 based upon procedures that have been implemented in 

[171 the past in high quality social science research 

( 18 ) and have been peer reviewed and endorsed by that 

1191 process, and so the sampling procedure, the 

(70) interviewing procedure, the questionnaire design 

[ 71 ] procedure, the data processing procedure, the data 
[771 analysis procedure, everything that was done to 
[23] generate those data conform to the — to practices 
[24[ that have been endorsed by our fields previously. 

[ 2 S) O: You are talking about the SRBl survey 
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PI now? 

PI A: Yes, 1 am. 

HI Q: Not the deposition survey? 

(51 A: That's correct, 

isi Q: That wasn't done with the deposition 

m survey, was it? 
i»] A; What wasn't done? 

|9| O: You wouldn’t say that the deposition 
(iiq survey was done in accordance with established 
|ii] procedures used in your field for decades, would 
( 12 ) you? 

(131 MR. HEFTER: Objection. 

114) A: The sampling procedure and respondent 

[IS] selection procedure, to the octcni that I know 
pel about it, was done conforming to conventions in our 

(IT) field.The analysis of the data svas done according 
[i»i lo well-established conventions in the field.The 
Ii9t process of interviewing is not typically done in 
po] surveys. 

I 2 i| Q: Is there something called consistency 
|77i checks thai you can do in connection with the 

p3l development of a survey? 

I74| A: The term "consistency checks" is 
I25I sometimes used to refer to for the following idea. 
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U you ask people — if you ask a single person 

more than one question during the course of an 
interview or multipic interviews where there is a 
logical relationship one would expect between 
ans<(vcrs, one can check the extent to which those 
anstlers are. in faa, consistent with one another. 

*o illustrate, if 1 were to interview you today 
and ask you how old you are and then I interviewed 
MWB^gain exactly one year from now and I asked you 
how old you arc then, there is a logical basis for 

ing that you would be exactly one year older 
lat later time point, aixf’SQ.a^onsistency 
k would be to confir^^^^^^u did. in fact, 
number that was one digit greater than what 
id today. ^ 

Were there consistei 
nncction with the SI 
. HEFTER: Using his 
whai a consistency chcc 
MR. BLEAKLEY: Yes 
Yes. 

Q:^ho did them? 

■ did. 

Tell us s||^hcm._ 

8:01 

Krosnick 

These arc act quite factual 

i|crs as in the example 1 j^^i^scribcd, where 
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your age today and 

■JVCTSfc 

tween the two 
entf^^y what your 
rview. 

^ions asked 
ted to one 
rfe):t consistency in 
but if the data 

colleacd in the way that I asked for 
to be collected, then one would expect to see 
insisiency of answers, and there arc two ways in 
;h 1 look for consistency in these data 
me is that there arc two questions that 

'hether respondents believed that cigarette 
causes lung cancer, one was the 
compraratives of relative risk, and the other was a 
follow-up question asking directly to respondents, 
do you believe that smoking cigarettes increases a 
person s chances to getting lung cancer, and so il' 
people reported a higher incidence of lung cancer 
among smokers than among ntinsmokcrs. one would 
expect that respondent to also say they believed 
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smoking increases the likelihood of lung cancer, 
and so I observed the consistency between answers 
to those sets of questions, you might say. 

In addition, I looked at the consistency 
to answers to the questions that were used to build 
the motivation to quit index.There again, each of 
those individual questions could yield answers that 
arc not literally matching some other panicular 
answer and be reasonable and accurate in their 
assessments, but we would expect overall people who 
express being more unhappy about smoking would also 
be more likely to say they want to quit. People 
who say they arc more interested in quitting would 
also say they arc more likely to try to quit and so 
on. So I look for consistency to answers among 
those questions and observed consistency there as 
well. 

Q; What do you do if you find that 
respondents' answers are not consistent when you 
conduct one of these consistency checks? 

A; Well,again, it would depend upon which 
of the two consistency checks you are doing. Let’s 
Stan with the age example. If you have a factual 
mailer where you have told me today you are 52 and _ 
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then in a year you tell me you arc 54, one of two 
possibilities is raised there; either you made a 
mistake in what you said on one of those two 
occasions, or the process by which your answer was 
recorded and transformed introduced that error that 
hadn't been there in your statements, and so I 
would investigate, if there were a large number of 
such discrepancies, what might have produced it by 
looking at whatever records'there would be and try 
to determine what the actual values are. 

In the ease of the — 

Q: I suppiosc there is a third possibility: 

1 lied. 

A: Well, I thought that was included in my 
earlier one, that you misstated it for whatever 
reason. You can misstate it for a variety of 
reasons. I meant lo include that in my earlier 
example. 

Q: Okay 

A; In the ca.se of the sorts of consistency 
checks I mentioned are possible with the SRBl data, 
seeing high consistency there is reassuring to an 
analyst in assessing whether the data were 
collected according to the instructions that were 
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(2] desired. 

PI If I had seen no consistency at all or 
(«l very dramatic discrepancies. 1 would have raised 
I5j questions and I would have a-sked, Gee, this doesn't 
|E) possible to me that respondents could be this 
O) inconsistent in answering two questions on related 
m then 1 would ask to reconstruct as much 

m record as could be rcconsirucied of the 
itq tvhich the data were collected and 

|tl| 

I'si Wowld it be the case, if there was 



TC^pt^nconsisiency betweeh 
be one from wh| 
jle to diaw any inferences? * 
»I%ER: Objection f 
A; I a^sorry, could 1 hear tA 


[■91 definition we have a^^e»i^^crc, 1 

[2o| t^m^T^S that Che data pert^^^^^o dran 
3it inferences, right? If there is cnou^ ^ 
ajl incd fta^|e n^ between the ans^jj^l^^ucsiioi 
aai doeP^il a^ct the ability to d ^w |nfe^ nccs 
Ml fror^iigsurveyi' 


that the 
}uld not be 


n guess 



m the new 


21 a misu 
3| OfthC 
t] 0:| 
SI validig 

*1 A: I 


2— 

I 

I't know what ‘enou 
3uld say. even not knowinj 
|oo. 

(Id you, if there were ifnough 
pi answers, would yod exclu 
^ of your survey? 

|tER: Objection. 

I am not sure what 
jfasonalty never cxclutk n^po 
&SS 1 had a strong bas^^m^ 


sure what 


them from 


but 

pscs from a 
^ng that 


^ras made in the collection or recording 


i«ie a thing called convergent 


cs that mean? 


*1 A: jMSl^Dravcrgenc validity is. in a 
tl sense, what we were talking about That is a 
q Standard for assessing the extent to which iwo 
1 ] diffcrcnl ways of measuring something yield the 
21 same resuii- In other words, do these two results 
m converge with one another.and to the extent that 
♦I they do converge with one another, then one has a 
si stronger basis for inferring that the assessment of 
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I [ 2 ] this phenomenon, whatever it is, has been done 
I PI validly. 

1 14) Q; What if they don't converge with one 
(5! another? 

(«i MR. HEFTER: Objcction. 
pi A; Well, convergence is always a continuum 
i>i in our field, we arc always estimating statistics 
PI that describe the extent to which two measures 
|tq converge with one another, and so if you have a 
|i 1 ) strong theoretical basis for cxpiccting the two 
[ 12 ] measures will converge and to use, 1 think, what is 
liq the implication of your question, you find a zero 
(i4| association between these, they simply do not 
H5i converge with one another, then one must — that. 

!■«] again raises questions worthy of investigation, and 
|i7i so then one must decide which of these two results 
ita] would one have the most confidence in. 
iiq In my cxpeficncc, generally speaking, 
tax when you expect to sec convergent validity, you do 
pij sec convergent validity — excuse me, when you 
1221 expect to see relatively high conveigent validity, 

123! you do sec relatively high, and when you find 
IM) divergence among what things you think should 
(251 diverge, again, a careful examination of the 
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PI procedures by which those results were genenced 
PI allows one to reach the conclusion you can have 
w more confidence in one of them than the other. 

IS) Q; Were there any consistency checks 

!«; conducted by you or anyone else, to your knowledge, 

in in the deposition Survey? 

m MR. HEFTER: Using his definition of a 

191 consisicRcy check? 

{iq MR. BUEAKLEY: Yes. 

[itl A: No, not that 1 know of. 
ii 2 i Q: Was there any check for convergent 
[131 validity conducted, to your knowledge, in 
(Ml connection with the deposition survey? 

|is] A; Yes. 

I Itl Q; Please tell us how and by whom. 

nn A: In my initial written report in this 

|tai case. I described the results of coding of 156 

1191 depositions taken of Empire Blue Cross-Dluc Shield 

[201 subscribers who were ever smokers. My analysis 

P I yielded a series of frequency distributions, 

[ 22 ] percentages of people who were coded into various 
[231 categories. In my supplemental report, results arc 
P4i provided on coding of additional dcpiosnions from 
psi Empire Blue Cross-Blue .Shield and other Blue 
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Cross-Blue Shield or Blue Cross plans, anti 
convergcni validity is — an assessment of 
convergent validity is afforded by comparison of 
the analyses in the first repon to the 
sii^plcmcntaJ repon. 

: You mean, because there arc both Empire 
non-Empire Blue Cross subscribers, is that what 
permitted you to make a check for convergent 
ity? 

No, not paijiculaily- 
: 1 don't understand what your 
iplcmcntal repon didNi^ results in a — that 
jsists of a convcrEenltya^^^heck.YQU will 
haVe to explain it again ^me. 

^ Okay. Ido not have^ST suo^ 




rctical basis for ex 
s-Blue Shield ever s 
rms of the key varia 
arch here from indi' 
smokers hut were not si 
;fs 

T^ink the processes 
arc likc^l^^c quii 
lation, thcrcfi 




ipire Blue 
iscribers to differ 
terest in my 
o were ever 
to Empire or claim 

studying 
in the American 
ing at the 
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crgcncc between 156 coding described 

y first report and the oofi^^rcsults for the 
r Empire and non-Et^^^^roiividuals all 
psed together as dc^TiS^Slh my supplemental 
rt is a basis of sayin^lP^Cftf^o two analyses 
,similar way with twci^^fcic® groups of 
Ic, do you reach api^^^raftely the same 
fusions. That would ^^^^^ essment of 
ergent validity, and »if^th^ ease, because 
C results of those tw ^p^i^^ codinRS were 
tc similar to one another, that gave me 
mficani confidence in convergent validity, and 
Tcfore. validity nxire generally of those 
ts. 

Earlier this morning, when I was asking 
bout some of the potential problems with the 
you used the word “bias.'" Do you remember 

that? 

MR. HEFTER; Objection. 

A: Not particularly, but. okay, 1 will 
accept that I did 

a: Is it a problem with surveys.a 
potential pniblem, bias’ 

A; Yes. it is a potential problem, yes 
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0: Would you explain lo us how bias is a 


121 

IS) potential problem in survey research? 

I4j A: Well, there arc many ways in which bias 

(51 can be a potential problem. 

i$i For example, if a data collection 

m procedure is biased toward gening infomnation from 

isi some types of people and not other types of people, 

I9I that can distort the gcnctalizabiliiy of the 
110 ) results. If a particular question is worded in a 
liil way that encourages some types of answers and 
(121 discourages other types of answers, that would also 
1131 be another sort of bias. 

( 14 ! Q‘- Any other ways? 

151 A; Well in the case of the deposition 
( 15 ! analysis that 1 did, there can be bias in coding of 
(171 questions. If an investigator hopes to obtain a 
(isi pamcular result and docs the coding him or 
I ISI herself, his or her hopes or desires can affect the 
(201 decision, and that could be the result of a bias. 

PM Q; Is there a poicnual for bias when the 
(721 person conducting a survey is an advocate of a 

123) particular issue or position? 

124) A: There is a potential for bias just as, 

(251 along the lines I just spoke of. In other words, _ 
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Si each of the procedural decisions that a researcher 
ra makes can either introduce or minimize the 
(4) likelihood of bias. 

I5) O: For example, if a survey is conducted 
ISI purely for purposes of litigation, doesn't that 
(71 present an opportunity for bias? 

I5| MR, HEFTER: Objection. 

191 A: It doesn't provide an opportunity for 
(ifll an^ rnorc bias than any other setting. 

|ii| Q: Do you think that when a survey is 
( 12 ) conducted by an advocate of a particular position 
|i}| for purpose of litigation on that position, that it 
ii4( is csfsecially important for that survey to adhere 
(1.51 to some of the standards that have been enunciated 
( 16 ) in the literature? 

(IT) MR. HEFTER: Objection. 

118 ) A; I think it is always important for all 

(19) surveys to conform to those standards. 

( 20 ) Q: How do you avoid bias or keep it to a 

( 21 ) minimum in survey research? 

|( 22 ) A; Well, each potential type of bias calls 

|73i for steps that can be taken to minimize it.and so, 

|24| for example. I began by talking about sampling bias 
psi and in order to minimize the likelihood of sampling 
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PI bias, one uses one of ihc established or 
PI defensible, representative sampling procedures, and 
t4| one implcmenls the dau collection according to 
IS) principles that minimize the likelihood that 
IS) e^nam-^spondcnis will be interviewed over 
m Others. Ill designing questionnaires, one seeks to 
PI ^i^^^^mciplcs that minimize the likelihood that 
( 9 ) i^spondcnts are pushed toward giving certain types 
' i as opposed to others. In doing coding, 

1 C sces\o it (hat the coders arc blind and don't 
t any expectations cv hopes arc of any 
will come out of thOtud^nd so on. 
about this a 

is morning, but isn't the nottmponse 
previously discus^d^sn^ihat 
in the literature as t||rtg|@|5ponse 

c liteiaiure, it would 
vcr. a phrase ‘the «' 



zi) The^phrase ‘nonresponse bias’iitsclf 
the literature and nj 
£ of^eat interest Jo Surisp. 




use It s a j 


’ of biai(§^d our 





3^11:30 01 
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ys to minimize 
is it a source of bias? 
by definition, it is a 
rs) nam^sav^ias,and therefore 

Q:%itoiS^does it affect the valiSit^of 
rch? 

ER: Objection, 
re is nonresponse bi: 
it is bias. In other svoeds, 

bias is the insianct ^^^^ i picoplc 
gterviewed fora survey are systematically 
am people who are not interviewed for 
vcy but selected to be interviewed in ways 
different results for the survey than 
ye occurred if those not interviewed 
3uaf^h%d been interviewed, and so if such 
.then that’s a bias. 

MR. HEFTER'. Peter, we have been going 
for close to an hour and minutes '*'c 
1 ] would like to take a break, if it is 
21 convenient. 

3 , THE VIDEOGRAPHER: The time is 1 1:2 I 
4| a.m.This completes tape number I of the 
51 videotaped deposition of Jon Krosnick 


25—11:41 41 
)il Krosnick 

IT) CRcccss taken.) 

Pj THE VIDEOGRAPHER; The time is 1 1:41 

PI a.m.This is tape number 2 of the 

IS! vidcotapied deposition of Mr. Jon Krosnick. 

^ BY MR. BLEAKLEY; 

[7) Q: Docs nonresponse bias present a special 
»! or peculiar problem in connection with telephone 
191 surveys? 

10 ) A; No. 

11 ] Q: No difference between telephone surveys 

112 ) and any other kind of survey insofar as nonresponse 
ii;^ bias is concerned; is that your opinion? 

A: My opinion is that nonresponse bias, if 
|i5i it occurs, is a problem equally for all kinds of 
li«) surveys, yes. 

Q; We discussed this a little earlier this 
ii«i morning, and you talked about current literature. 
li»l Can you tell us what current literature you are 
[291 talking about that suggests that nonresponse bias 
Ri) is not a problem? 

R 2 i A; Yeah. Well, there arc at lease two key 
P3I studies. One is, as I mentioned earlier, a paper 
p4i in the new issue of Public Opinion Quarterly.The 
[251 authors of Eleanor Singer. Stanley Presser and 
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[ 2 ] Richard Curtin, and this is a study that uses 
BI decades'worth of University of Michigan survey 
HI research center telephone interviews to look at the 
(SI impact of nonresponse bias associated with low 
16 ) response rates and finds essentially none. 

(7) The second key papier was published in 
(6) the last couple of years, a research study that 
19) Scott Kcctcr is one of the authors of the 
|t 0 ) publication, if not the only author. K^e-c-t-c-r, 

|ii| and this was a study funded by Pew Foundation, 

|121 P-e-w. and it similarly compared higher rcspionse 
1 13) rate telephone surveys to lower response rate 
[141 telephone surveys and found no sizable bias to 
iiS) result. 

[ 16 ) Q; Are you familiar, can you identify for 
I17) us any literature other than these two pieces that 
iiei conclude that nonrespwnse bias is not a problem? 
I'9I 
[201 
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A: Not a problem ever? 

Q: Why do you put the — why did you ask me 


pt] that way, nonrcsjxmse ever? 

iz?] A; 1 — 

1231 Q: Arc you suggesting that there arc. even 

124] with these two aniclcs you have talked alxuit, some 

(25) instances in which nonrespon,5c bias can be a 
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t'l 

P) problem’ 

PI A: Well, I guess we are gening a liulc 
r*i mixed up on icrminology here If nonresponse bias 
rsi happen.s. that's a problem The studies 1 mentioned 
ale studies that evaluated the extent to which 
[7) lower response rates enhance nonresponse bias, and 
answer from those studies is that they do not 
»' (9l do SO So, I am sorry, maybe I answered the wrong 
^.stion. 

Do you haye any other literature that 
can identify for us besides those two articles? 



^Fl. HEFTER; Are you-a^ 
osition? 

Which proposition^ 
i Thai the lower res 
bicm. 

IR. HEFTER: Objcctio’n. 
Well, I didn't say ih 
I 20 | was that the — these pai 
r?ij that substantially reduce 
^ncc nonresponse bi. 
e which I mimtionc 
it I pubiisf^^rah oih 
lion Qua^^^^ few 


k the same 





said 

udies showed 
rcsp>on|e rates docs not 
re other studies, 
^whcrc in a [taper 
s in Public 

ago, maybe 199"?. that 


la 40 
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ompared surveys low rcspionsc 

"(65 to surveys with relativetyj^h response 

and found more acc^^^j^hc lower response 
e^urveys than the hig %r res ponse rate surveys, 
ere are many studies that h^’c been 
comparing, in terms^^^^^graphics now, which 
ing gears for me, br^ause I have been 
hg about substantive J 



ides, if you shift over 
phics, many stud 



haviors and 
earring 

|hown ihai even 

i with relatively high response rates do 

ly underrepresent some segments of the 
opulaiion.Thai would be called nonresponse bias. 
Ligh it is typically very small when the 
^Vs are done well, and that nonresponse bias is 
j^)r statistical weighting adjustments that 
btimes done to compensate.Those weighting 
adjustments also have been shown topically to 
pmducc very small or no differences in the results 
jnj of survey investigations, which is additional 
f»l evidence that ihat relatively small rate of 
[73} nonrcsjxjnsc bias docs not distort conclusions about 
[241 Substantive matters drawn from those surveys. 
f3S] Q: Are you familiar with the term 
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"incligibics," as it is used in connection with 
response rates and survey research? 

A: Yes. 

Q: What does it mean? 

A: If a survey design specifics that 
individuals from a particular population should 
provide data, and the process of interviewing 
potential respondents leads to some interviews 
being conducted with people who do not meet those 
criteria, then those people would be idcniifted as 
inciigibkc, so. for example, if you wished to 
conduct a survey of a representative sample of 
American adult residents age 18 or older and you do 
so by telephoning American households, and find 
that a potential respondent actually is not a U.S. 
resident, then that person would be deemed 
ineligible. 

Q: Docs a good Survey provide a description 
of the number of incligibics? 

MR. HEFTER: Objection, 

A: Well, a survey wouldn't provide a 
description of anything You could have a report 
on a survey and ideally — it depends on who the 
report is written for. Some contexts call for more 
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detail than others, but in contexts where people 
are most interested in all of the details possible 
on a particular survey, it would be useful to 
describe that percentage, yes. 

Q; Did you report the number of incligibics 
in connection with your telephone survey? 

A: Yes, we did. 

Q: Do wc kimw the number of incligibics in 
connection with the deposition survey? 

A: 1 have, in the e-mail that I received 
last night and will get to you very shortly, seen 
numbers that indicate something about incligibics, 
yes. 

I am sorry, did I answer your question? 

What was the quc.stion again? 

O; You answered it. 

A: Okay. 

Q: When you calculate the response rate, is 
it proper or appropriate to include the number of 
incligibics? 

MR. HEFTER; Objection. 

A: It depends on why individuals are 
ineligible, so, for example, in the SRBl survey, in 
calculating the response rate, one would want to 
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izi take imo account all individual who were 
PI interviewed fully, according to the questionnaire, 
m including both current smokers, former smokcrs.and 
IS) never smokers. 

,,One,mght, in a son of colloquial way, 

^onsidefkhc nonsmokers to have been ineligible for 
cy, but that is not the ease They were, 
an, asked questions in that survey, and 
1 ^ belong as a pan of the calculation, 
ft other hand.af you were doing a 

mcrican households seeking Atncrtcan 
fand your telephone cMbl^rou to a 
1 that included no Am^^^^sidents, then 
Bu would not incorpioiatc tha^alculaiion — that 
ncligibles in your of the 


alcuiaicd the respwnse rate 
|hone survey at 51.9 

Q; What did you calculate it 
percent in the re 
73) calc^^d ^ SRBl, not by me. 
aq QiJgHl^sptonsc your 

^ calculat^^^ 51 

Kros. 




§OTry, )ust — I want to m^^^ire 
right. Can you say l^^^c^^nore 



cent by SRBl, 
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sRir“'^ 



hone 


ur testimony that 
he response rate for 

.Iculaied a response 
tear about that 
ispionsc rate they cat 

nt? 

%■. 

sjcorrcct. 

calculate one separately.’ 
lave. 

5 it? 

7,5 percent. 

included in that 

<) calculation? 

O A; Again, we just need to be clear about 
1 ) ineligible why. Ineligible in the sense that they 
31 are never smokers, yes, they were included in that 

31 calculation. 1 would not call them ineligible in 
q the technical sense of that term. One could 
sj imagine calling them ineligible colloquially, but 
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that would not be a projxT use of the term 

Q: Why not? 

A: Because they were eligible to be 
interviewed and they were interviewed.They did 
answer questions. 

Q; If the incligiblcs, consisting of never 
smokers, had been excluded from the calculation 
made by SRBl and by you of your response rate, what 
would it have been? 

Mfl. HEFTER: Can ] hear that back again, 
please? 

CRccord read.) 

MR. HEFTER: Objection. 

A: Okay. First of all, I wouldn't call the 
never smokers incli^blcs. Second of all, if those 
people were omiiied, then you would not end up with 
a response rate. 

Q.: If you had not included them, all the 
never smokers — put aside for the moment of 
whether they were or were not truly incligiblcs — 
if you had not included them, the response rate 
would have been significantly lower than 51 
percent, wouldn't it? 

A: No. ___ 
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Q: W'hy not? 

A; Because there arc a number of different 
ways that you can calculate a response rate, and 
none of them would match a procedure that would 
exclude those people, so, in other words, you could 
compute a percentage, but that percentage could not 
be called a rcspionsc rate. 

O: But it would be lower than 50 percent, 
whatever you called it, wouldn't it? 

A; Yes, you could — yes. 

Q; Would you explain for us how it is that 
non, never smokers ate eligible,but you describe 
them in your expert report as not qualified? 

A: First of all, 1 didn't describe them as 
not qualified.Thai's in the appendix provided by 
SRBl. they are labeled that way, and secondly, what 
they meant by not qualified is simply that the 
filter questions that asked have you ever smoked 
cigarettes regularly led these people to give 
answers that indicated they did not need to proceed 
with the survey any further, that, in other words, 
they had completed the survey fully at that point 
for them. 

Q: At that point, when they had completed 


•age 363 - Page 366 (24) 


Min-ll-Scriptt» SPHERION DEPOSITION SER’VICES 


http://legacy.library.ucsf.ed Lfaid/iipjO^OQ/pdf fw.industrydocuments.ucsf.edu/docs/ryhl0001 


52434 5507 





/E CROSS A:VI> blue SHrELD V. 
nJP MORRIS 



JON A. KROSNICK 

March 12, 2001 



3—11 54 43 25 — "i^ : 56:<12 
Krosnich 

the survey fully, did the never smokers answer any 
of the questions that formed the basis for the two 
opinions, the rwo goals of your survey? 

A; No. they had rtot. 

^Q: I believe we talked on February 12th and 
al^ earlier this morning about randomness, right? 

: 1 don't remember it this morning, but. 
okay. 

: You would agree with me, would you not, 
randomncss.is a key element of a good survey? 
; Sometimes procedures that invobc 
crating random numl^t^arc yscful. yes. 

R. Bt-EAKLEY; May Ij 
read back, please, 
ccord read.) 

^ And there arc time 
^useful? 

A: Yes. there arc times ^ 
muscful. \ 

Q: Explain for us whaii 
useful to have a surve 
a couple of exa 
: 1 am try^[|^ decidi 
us cxatT&UNicwould 


Pa9e 367 




andomness is 




^^^domncss is 
^^^urvey would 

s not randonx? 


f the 
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III Krosnick 

ra selected 

[ai Q: Was the sample selected or generated in 
W connection with the deposition survey random? 

(SI A: Yes. 

|6i O: How do you know? 

PI A: I think, as I described in my last 
m deposition. I had a lengthy telephone conversation 
I9] with individuals from the firm that selected the 
jltoi sample from the population listing and heard a 
|iii description Of the procedure by which that was done 
( 12 ) and asked some clarifying questions and concluded 
)<aj that I understood how the process was done and that 
Ii4| it involved a random sampling procedure. 
iisj Q; Were the nonsmokers interviewed by 
iiq Audits & Surveys in connection wicb the deposition 
iion survey, were they cligibics or incligibles? 
i>il MR. HEFTER; Objection. 

!H( A: You have to say eligible for what. 

Pd Q; Were they incligibles? 
pij MR. HEFTEH: Objection. 

1221 A; You don't want to say eligible for what? 

1231 Q; Answer the question the best you can. 

(24| MR. HEFTER: Are you using his 
( 2 si definition of eligible or the colloquial 
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lim Variable 

i 

^ircs at times. 


j:00 

|thtnk, if 1 undcrsianc^^^^^stion, 

1 arc referring lo randomt fe^jtjn the sampling 
|css, and randomness ^^^^pipiing process 
iit be compromised u^^n'o'n^ implements relatively 
3lcx sampling procedBfttfSflBtf stratified 
^pling. for example, where the# arc elements of 
^mness in the procci^^^^^re are elements of 
ss.as well. 

^miMT-ly, you can use ibn< 
ation in designing q 

Toften we don't do chat We ask'all respondents 
ame questions instead of randomly assigning 
yndents to answer only some questions. 

^as that helpful? 

5^ L>id you randomly select the sample in 
telephone survey? 

' did not select the sample 

|i«l at all. 

120 ) Q; Did SRBl randomly select ihc sample that 
pi) was used in your telephone sun^ey’ 

1221 A; SKhI did nol select the sample at all 
P31 Q: Was the sample used in your telephone 
I24J survey randomly selected? 

IPS! A: II was randomly generated, not randomly 


2 — 11 : 59:16 25 — 12 : 01:11 

[tj Krosnick 

(21 definition? That's what I am getting hung 
(si up on. 

(4) Q: Answer the question as best you can. 
rs) MR. HEFTER: Read back the question, 

(q please. 

(7) (Record read.) 

(■I A; I guess there are two answers, yes and 
m no.They were eligible from the point of view of 
lid) what I believe to be the survey that Audits St 
(III Surveys conducted,although 1 don’t yet have 
(121 complete derails on how that was done.As far as 
(121 whether they were qualified to be deposed in this 
(Ml ease, the answer is no. 

Q; Whai is statistical significance, as 
(161 that tcim is used in connection with survey 
(iJi research? 

jisi A: Statistical significance is a feature of 
(19) a statistical relationship between two variables. 

(201 It can be used to describe differences between 
pil groups of people, for example, or it can be used to 
[27J describe a relaiionship between two variables,and 
(23{ it assesses the etnent to which an observed 
jl24| difference or relationship could have occurred by 
IPS) chance alone versus the likelihood that it did not 
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nj Krosnick 

m occur by chincc alone and is, instead, anribuiablc 
P) to some systematic pancm or force. 
iaj Q: What is its relevance to survey 
IS) research? 

ici We^, it’s relevant in a couple of ways. 

0nc is th^ statistical significance is used as a 
m c^^^^^^or evaluating relationships observed 
PI bpween variables, because we often do that in 
(Id) example, we might be interested in 

ltti v^dier^ople’s political party identification is 
(iq rej^^d^their vote choice in dections, and so 
d compute a corrclaticmbci^^n party 
^on and vote choice. that 

ip to a test of statistic^ significance 
probability that th^at»er^d 
It) rclacions^> happened just by or is 

It] the foot that in ihepopulawn these 

is; tA^MM^Ies do tend to co-var^^m^^c another. 

701 III this case, perhaps the more with 

71) the Republican Party, the more ^e^ arc to 
22 ) votC'^^Aroubiican candidatc5.||^§^@^nc way in 
73) whi^^uti»cal significance is 




ond way 


t’s reli 


would 



2—12:03:57 25—120508 
|i| Ktosnick 

|7i Q: And how do you measure statistical 
PI significance? 

|d| A: Well, there arc many different ways to 
isi do it, and it depends upon the prarticular test that 
ie; you arc conducting, the particular variables 
j7! involved, the distributions of responses to the 
m variables and so on 

PI Q; Let's take your telephone survey, for 
lioi example.Arc the results statistically 
ill) significant? 

]li 2 ) A: 'Well, one wouldn’t normally ulk about 
(is; results as being statistically significant in the 
iui generic term. One would say. is a relationship 
(isi between two variables statistically significant, or 
I IS) is the effect of a manipulation statistically 
ii7i significant. 

IK] Q: Let's take, for example, your motivation 
to quit index. When you were developing the 
ITO] questions and had in mind doing this motivation lo 
171 ] quit index, did you attempt to ensure that the 
1271 results would be statistically significant? 

P3I MR. HEFTER; Objection. 

iwl A: One doesn't take steps to ensure that 

I 2 si results arc statistically significant. One lests 


Page 373 


2 — 

Kros ijick 

where experiments ^^IHflRinto 
■ii^crc.as in the case of th^^^ study 
'" s are randomly assig^^^^ asked 
i\crsions of a single ques^n or to be 
nt sequences of qucsfionL^cn one 
d in assessing the likt^h ^A^ at what 
II dependent mcasu^^^riablcs that 
it possibly to be influ^j^^ilKihis 
n, were, in fact, infli^nc |d by it or 
re, statistical signtfici^^^^^ld be 
to assess the possibility, then, in the 
Terence bciwccn groups of respondents 
ppened by chance versus is likely to 

a manipulation implemented by the 


■I or dai 


tng or attempting to use: surveys 
iurveys to draw inferences, the 
9| definition wc adopted here earlier this morning, is 
s]) statistical si^ificance impurtant? 

A: Often it is. almost always, yes. 

O: Almost always, it is important, right? 

A: Almost always. 

Q; Is it important in this case? 

A; Yes. 


Page 372 | 2—12:05:11 25—12:06:47 

lij Krosnick 

[7| whether results arc statistically significant. 

PI O; Did you test whether the results of your 
PI rtmiivation to quit index are statistically 
isi significant? 

I6] A: Again, you wouldn’t say the results of 
PI an index are statistically significant.You could 
Id say, is an effect on the index statistically 
PI significant, which 1 did test, is a relationship of 
fioi the index to some other variable statistically 
im significant, which I did test, bur you wouldn't 
|i7i simply say is the index statistically significant. 
[isi Q: And you found them to be statistically 
lK| stgnificani? 

Ii5l A; in my report. I described tests of 
jliet statistical significance, some of which indicated 
(171 significant differences, yes, and significant 
(!») rclaiionshijM. yes 

(191 Q: Let's move on. Is there a term in the 
[ 70 | survey research literature called social 
tan desirability bias? 

!p 2 l A: Yes, there is. 

|(73i Q: Would you tell us what that is, please. 

|( 2 «l A: Yes Social desirability bias has two 
tps] components to it, and it is the possibility that 
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[)| Krosnick 

[21 respondents rr*;'/ nusrepon either behaviors or 

PI beliefs or aiiiiudes in ways that lead them to 

|4| appear more adirurable by people in general, society 

isj in general. 

.jsi Is that a problem in survey research? 

[7| ^R. HEFTER: Objection. 

If it were to occur, that would reduce 
tBj the inaccuracy of measurements, yes. 

Reduce the inaccuracy or — 

: Thank you^ reduce the accuracy of 

suremems. 

b: Arc there svays to social 

pliability bias in a 
Yes 

; To your knowlcdgi^^erevere any 

rability bias in 
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jurvey? 



[IT] m^lhods used to avoid 
^nection with the de{ 
jtR. HEFTER: Objecti- 
: No, 

Q: Let me ask you wh| 
i^estion is one that is 

^desirability bias. oSay^ 

,'lf you h^a^g^wn c 

tnic whc^SBS^staned^Siifpuld you have smoked? 


folio wring 
j subject to 




16 

i ' Krosnick 

|: Lei me answer ihis^l^i^l^nsivc 
iearch has investigated tlTt''<^cnt to which 
I desirability respons^^^soccurs, and the 
ditions under which What that 

rch shows is that inift^jirlgllf^rs' intuitions 
ui whether a particuUr qucs^n is or is not 




nsc bias is rioi 
a good 
^inability response 
t occur simply 


Sect to social dcsitabip 

ific. that researchers) 

^lion to guess when t 
I will occur and whetj 
[^looking at the wording of an item. 

^n eases where researchers thought that 
?rc was a powerful social norm, there turned out 
^lo be. In cases where researchers thought that 
icfe was a powerful social norm, it turned out 
idtffcreiu individuals perceived different 
iln eases where researchers thought there 
[191 vvas not a norm, it turned out that there was one 
i?oi So 1 don't personally feel qualified to give an 
Ri| opinion aNtut whether a particular item is or is 
I 2 ?i not su.sccptibtc to social desirability bias. 

I 2 S 1 Q: In your telephone survey, did you take 
I7si any steps to avoid social desirability bias? 

I7si MR. HEFTEH; Objection 
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[11 Krosnick 

121 A: Yes. 

01 Q; What steps did you take? 

(4| A: Anonymity of respondents is one key 
[s| step, confidentiality of responses is a second key 
1*1 step, and both of those wete implemented in that 
m study, 

I 81 Q: Did you take any steps to avoid 
I9i questions that in and of themselves could produce 
llioi social desirability bias’ 

|ii) A; No. 

Ii7i Q: Let me ask you about a couple of other 
MSI questions. 1 want to ask you whether this one is 
|i4| subject to the social desirability bias. 

|isi "Did you know smoking could cause lung 
|i«] cancer when you siancd?" 

|i7i What is your opinion on that one? 

|i«l A; I do not have an opinion about whether 
|i9| that item is or is not likely to be subject to 
1201 social desirability response bias. 

12 i| Q: Another one: “Did you think that you 

1221 could get lung cancer if you smoked back when you 

I23| started smoking?" 

(24| What about that one? 

[251 A; I don't have an opinion about that one 

2-12:11:27 25—12:12:22 Pag« 378 

ig Krosnick 

(21 either in this regard. 

|3| Q: And the reason you don't have an opinion 
(41 is you don’t feel that researchers are qualified to 
(SI express opinions about whether particular questions 
(El arc subject to social desirability bias: is that 
n right? 

(»1 A; No. 

W Q: Then why is it? 

(101 A: I feel that researchers arc qualified to 
(111 make that assessment because we have developed a 
jli 21 variety of techniques for empirically testing 
[i3| whether a particular question is subject to social 
|t4i desirability response bias, but without 
(151 implementing those procedures fora particular item 
(isi and empirically testing whether it is subject to 
(17] this bias or not, I believe that researchers are 
(151 not in a position to offer opinions simply based 
(191 upon their intuition. 

( 2 oi Q; And you didn't conduct any such tests on 
(?i| any of these questions, did you? 

1221 MR. HEFTER: Objection. 

1231 A; That is correct . 

124] Q; Nor do you know of anyone else who did? 

(251 A: I do not know of anyone else who did 
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j Krosnick 

PI Q: And you didn’l implement any of those 

131 procedures in connection with your telephone 
HI survey, did you? 

A; No. that isn't correct. 

procedures did you implement other 
mity of respondents to ensure against the 
rabiliiy bias in connection with your 

EH; Objection, 
deniiality. • 

methods other ihan^onTidentialiiy 
^ty did you implcmeni^^^incction with 
tone survey to ensur^j^nn^thc social 
bias? 

EH; Objection, 
ng else. 

ou do any tests or ani '^^>aiy| 

’"I or not social desir 

201 resulted in your telephone survi 

22 ) Q: >TM^e ur knowledge, did ai 
235 tests oFan al^cs to dejcrpiinc v 
24| desir^^^was pre 
2S5 deposj 
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A: 

n dcst 

W O 

IS) who 

m socia: 
in the d 
W A: 

m O: 

roi dC: 

M| confii 

12] A 

13] Q: 

14] A: 

tech 
s] Th( 

7) pipelij 
*1 Q; ’ 

9| A; Pipeline. p-i-p-e-l-i-n-e. 

ni A third approach is to measure and 

•tt statistically control for individuals' disjjositions 

■ 2 ) to offer socially desirable answers. 

at O; Is that it? 

4| A: That's what I am remembering ai the 

41 moment. 


lly we would not say 
was present in quest io^ 
u test or do you knc|^LS«H^ne 
or analyzed whcthci|<grjj{$^ there was 
bility bias present in'eonne^on with 
lion survey? 
o not. 

ere means for avoidi^ 
lias other chan anony 
.iiy of survey respond 
ere are. 
ire they? 

ic is called the randomized response 
nd one is called the bogus 
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|t| Krosnick 

i?i Q: Were any of those three methods employed 
PI in connection with your telephone survey? 

Ml A: No 

[S| Q; Were any of ihosc three methods employed 
H) in connection with the deposition survey? 
f7| A: No. 

Ml Q: is there something in the survey 

i3| literature called self-deception bias? 
t'oi A: Yes. 

inj Q: Would you describe (hat for us? 

112 ] A; It actually doesn't have a large place 

113] in the survey methodology literature. It's present 
M4] more in the social psychology literature, and it's 

I related to, it's an clement of social desirability 
iis) response bias that, in essence, social desirability 
[17] response bias can occur in one of two ways. Either 
lia] because a rcS{3ondcnt intentionally chooses to 
|i9i misrepresent himself or herself to the researcher, 

120 ) or because the respondent doesn’t intentionally 
i 2 i| choose to do it. but, rather, an element of the 
122 ) nonconscious mind leads them to do it without their 
1231 conscious decision to do so.The latter would be 
124] called self-deception. 

( 2 S 1 Q: Is there a difference between the latter 


2—12:16:40 26—12:17:46 
Ml Kfosniek 

121 and what is sometimes referred to as cognitive 
PI dissorunce? 

|4| A: Absolutely. 

(51 Q: Tell us what the difference is, please, 
m A: Cognitive dissonance is a theory that 
p] comes from a very different tradition.The theory 
1*1 simply says in very general terms that under some 
ID) circumstances people find it unpleasant to hold two 
[101 beliefs that are logically inconsistent with one 
ltij another, and the unplcasamness that people 
Ii 2 l experience is called dissonance and is thought to 
ii3| inspire people under such circumstances to take one 
Ii4| of various steps to reduce the dissonance. 

MS) Q: Is self-deception bias a problem. 

(i«l potential problem in connection with survey 
Ii7i research? 

|t«j A; Yes, it’s a potential problem. 

MSI Q; Did you do anything to avoid 

I 2 <^ sclf-dcceprtion bias in conneetkm with the 

pi] telephone survey? 

(221 MR, HEFTEH: Objection. 

(231 A: No, no. I did not. 

P41 Q; To your knowledge, was anything done in 
[241 connection with the dcpiosition survey to avoid 
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i;i Krosnick 

[21 sclf-decpption bias? 

PI MR, HEFTER: Ob)CCi ion 
1*1 A: No. There really are not 
[51 wcIFestablishcd techniques for doing that, 
wjsi Let me show you a copy of your report, 

f tn Whfch t think was itutked at the last deposition as 
^^g^osition Exhibit 1 1 / you will, turn to page 
28. 

HEFTER: I don't need an extra copy. 

|jii| but'if I can just have a second to open up 
iTO^ricfcasc to get it — 

BLEAKLEY: Okay.^' V. j 
HEFTER: Thank 
Paragraph 76 , do yeS sec that? 
^^^^^^Uh-huh. 

Mn S; In paragraph 76 , is a 

^^yi^Drciical basis for expectingiMt at least some 


above correlation 
[20] smoking behavior is due 
pi| of smoking behavior." 

see that? 

Tell us ^^^'ou m 


health beliefs and 
^oc rationalization 



i Krosnick 


k. In this ease, once a ! 


I^ntiiated regular smoking, th^^^son may have two 
^ii^^^fs that arc inconsist^^^^h^nc another. 
l^OtK belief is I smoke cigircncs regularly, the 


nd is smoking is dangerouT^ my health, and 


would potentially, fo ^g^ ^^di vidua Is. 
^^^te a sense of dissonaficc**^^ 

Does post hoc of 

^S^^^vior, and in this cas^smoki^ behavior, 
ii ^^M» ent a potential probl^^^^^^nection with 
P^^^ey research? 
ji^^^R. HEFTER; Objection. 

(1^ A; I am not really — I am not — I am not 
n^^^r how to answer that. 

I'i^^^lf one’s goal in survey research.as is 
[iCt^^aJly the ease, is to measure people's 
li^ ^^ ^ ^ tiqns, measure people s behavior, measure 
[lai their attitudes and so on. (hat it's not a problem 
[20) for survey research at all, so I am not sure — 1 
pi! am having trouble thinking of a way in which it 
P2) would be a problem Therefore — 

[221 Q: l>oes the fact that smokers engage in 

[2<1 post-hoc rationalization of their smoking behavior 

(251 present a problem in terms of (he survey research 


Iking behavior, 
^^^nection with 
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lil Krosnick 

PI that you conducted? 

PI A: A premise of your question is that 

^ [q smokers do this. I haven't aaually seen a 

I [5] convincing body of evidence to make the case that 
; (61 smokers do that. If smokers did do that, that — 

(71 and the reason that 1 raise this here on this page 
PI in my report, is that it would suggest an 
[B[ alternative interpretation to correlations that I 
I IB] mentioned on an earlier page in the repon other 
[III than the one that is the focus of my analysis. 

[121 O: Is it your opinion as an expen to a 
!i3t reasonable degree of scicmiTic certainty or 
[Ml probability that smokers do not engage in post-hoc 
|isi rationalntation of their smoking behavior? 

[iq MR. HEFTER; Objection 
[17) A: Well, I am going to use as a definition 
|i»t of post-hoc rationalization of smoking behavior, 
d ( 19 ) the dermition that 1 implied by its use in this 

^ [201 piaragraph.and there what I simply meant was that 

pt| smokers may adjust their beliefs about the health 
| 22 | risks of smoking so as to reduce perceptions of 
|23l risk involved. 

p<l I have not seen a body of scientific 
_ [ 2 si evidence that allows me to reach the conclusion to 

Pago 384 2—12:21:59 25—12:23 36 F 

ft| Krosnick 

| 2 | a reasonable degree of scientific probability or 
’<7 PI certainty that smokers do engage in such post-hoc 

Ml rationalization of smoking behavior. 
isi O; What do you think? Do you think they do 
[6| or they don’t? 

|7] A: So now think has a different meaning 
Ml than to a reasonable degree of scientific 
[9] certainty. 1 will interpret that as meaning do I 
l<oi suspect that they might. 

[11) 1 think certainly it is possible that 

[ 12 ) they tnighl, but i don’t have an opinion on this 
|i3| matter that I can base on solid scientific 

1 14) evidence. 

|tsi Q: Is asking questions in a survey that 
[<q asks for recall of past events a source of 
ItT] potential bias in survey research’ 

)iq MR. HEFTER; Objection. 

|i9| A; I wouldn ’t say it is a source of bias, 

[201 no 

[ 21 ] □: That sounded like a qualification. What 

( 22 ] do you think it is if it is not a source of bias? 

[23] A; It's just a — it’s just asking. 

(24] Q: Let me ask you (his: Is people's recall 

( 2 Si of past events something that you normally rely on 
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PI in survey research’ 

I3| A: Yes 

i4i Q; Do people tend to recall past events 
[51 accurately? 

)E| -pA: 

Q: Dojs their ability to recall past events 
““■'over time? 

Not consistently, 

ting people about fiast events a 
atcntiallsoorce Of measurement error? 
fEH: Objection. 

5.1 wouldn't say so. no. ‘ 

ting people in a surv^^S^in^their 
ast beliefs a source of bias 



nt error? j 

EH: Objection. | 

; people for their ^ 

70) (MSI apitu'dcs a source of poien| 

71] mcaii^nicnt error? 
M^^pElQER: Objection 


en you g^tn»ignin; 
uble yoi^^^that yi 






2—f 



Situdes? 



icstions 
nd other 
iracy of 


'S—12! 

fCrosj 

call past events, bef 
^s a very different qucstij 
it? 

nds on how you hoiiLjf 


i does that mean? 
as I said in my last de^ 

-today.there are way 
; the likelihood of ac cun 
iccTcasc the likclihoo^^ 

J;^and » just simply asking the question 
phrased it in these generic terms 
rtroubic me, but looking at the specifics of 
pne would provide a basis for assessing 
_is done in a way that increases or 
Itolikclihood of accurate measurement, 
arc ways of asking questions 
SI that decreases the likelihood of getting accurate 
a) answers, isn't that a source of bias or measurement 
ij error? 

71 A; 1 am sorry, could 1 hear that one more 
at lime or do you — 

4| Q: 1 will ask it differently. 

s; 1 thought you just said you can do it 



2 — 12:26 oe 
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[21 the wrong way and if you do. the results aren't 
PI reliable. 

(4j Mfl. HEFTER: Objection. 

[S] A: I definitely did not say that 

fsi Q: Okay. 1 will ask the question again. 

[71 Is it your testimony and your opinion 
m that asking people in surveys to recall past 
[91 events, attitudes and beliefs, does not present a 
I [101 potential problem of bias or measurement error’ 


Q; Then the answer to my question is yes? 

MH. HEFTER; Objection 
A: 1 guess 1 am trying as best 1 can to 
j[i7) provide a helpful answer. I think 1 interpreted 
[ 1 ^ your questions to be saying, docs merely asking 
(i« people those types of questions present an 
( 70 ] opportunity for that bias, and I took it to be that 
171 ] uniquely or especially or particularly powerfully, 
I 22 ] and the answer 1 just gave a moment ago is, 1 
|73| think, the way I should answer it, which is to say 
( 7*1 not uniquely, because every measurement has the 
( 7 S 1 potential for measurement error and bias._ 
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MH. HEFTER: Objection 

A: Every measurement in surveys involves 


(I'l 
(171 

iiJi the potential for bias and measurement error, so ■ 
l'*l 
['65 
'ri 
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PI Q; In general, do people's recall of 
PI events, beliefs or attitudes that took place a long 
|4| time ago, do they tend to be accurate or 

[S( inaccuiatc? 

MR. HEFTER: Objection. 

A: What do you mean by "a long time ago’’ 

Q; 25 or 30 years ago. 

A: There have been some studies done of (he 
(iq accuracy of recall stretching over that long a 
( 11 ) period of time, and those studies have shown very 
(171 high levels of accuracy in recall. 

(13) Q: So in your opinion, do people's recall 
11*1 of beliefs, altitudes or events that took place 25 

or 30 years ago tend to be accurate or inaccurate? 
MR. HEFTER; Objection. 

A; In my opinion, studies that have been 
done assessing recall accuracy over that length of 
(:»l time have shown high levels of accuracy for recalls 
poi of attitudes and beliefs. 

P'l Q: Did you take any steps in connection 
jpTi with the telephone survey to protect against the 
(73| possibility that pieoptc would not be able to recall 
( 7*1 past events, beliefs or attitudes’ 

MR. HEFTER: We are talking about the 
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[7| SRBl survey? 

PI Q; Your lelcphunc survey, ihe SRBI survey. 

PI A; Could I hear the question one more time? 

[ 5 | Q: Did you take any steps to avoid this 
problem, this particular problem? 

Jpj l^, HEFTER: Objection. 

problem? 

Q: The problem that people may not remember 
ately past events, beliefs or attitudes, did 
ake any special steps to ensure that that 
In'i happen here? 

1 did not because th< 
urement in that stud 
collections of past attS 

SOr. 

I you know wheil 
I in connection with 
. HEFTEH: Objection 
^Yes, I believe steps w| 

: What arc those steps 
Well, one step was ft 
pposiiions under oK' 
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^us of my 

the mcasurcmeni 
’bes, beliefs or 

eh steps were 
ition survey? 


jk. has th 
1 people 




to provide 
ing under oath, 
c the care with 
of anything.That is. 
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lieves in when 
as a part of its 
a reasonable 


kke them 


CrosPN 

I c^rsc. what the legal: 

Its putting people undePl 
pedings, and that seer 
osition. 

Q^ Lct me stop you thet^f™" 

; putting people under oath i 
cr better? 

I think, as 1 just said, I 
enable assumption t^ m^e ,) 
lOkay 

Secondly, there were'some questions 
I of people where visual aids were used. So, 
ler words, the respondents were shown pieces 
er, copies of documents and so on, and I 
^ those steps enhanced the likelihood that 
could provide accurate reports about those 
|ms as compared to if they had only been 
lisi described in abstract terms verbally, 
po] 1 am not thinking of other examples at 
pn the moment, 

pz) Q: To what documents arc you referring when 
[7si you say that the use of documents helps people 
rz<i remember? What documents? 
r?s) A: 1 am referring to what, to me. have been 
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m called exhibits that the lawyers presemed to the 
PI dcpioncnts during the sequence of questioning in 
Ml some or all depositions. 

{s; Q; What exhibits, if you recall, helped 
161 them remember? 

PI A; I am referring to questions asking 
(6i people do you remember having seen this document 
PI before, for example, and I don't remember 
M 0 | spcciTically which documents were used in those 
[111 questions. 

|iz| Q: What if the deponent said 'No, 1 have 
1131 never seen it before”? Docs that help them 
li<l remember their attitudes, beliefs or recall past 
(ist events? 

li6l MR. HEFTER: Objection. 

[171 A; ] am having trouble with the question. 

|iai Does answering a certain way affect 

[iffi other answers? Is that what you are asking me? 

I 20 | Q; No. I am asking you to assume for the 

I 2 ii moment that a document that was shown to a deponent 

( 2 zi in connection with questions about recall of past 

p3| behavior, attitudes and beliefs is, in fact, a 

(»] document that the deponent has never seen before. 

[ 2 S] and I am asking you whether, in your opinion. 
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[ 2 ] showing the deponent a document that he or she has 
ra never seen before helps them remember past events, 

HI attitudes and beliefs. 

IS) MR. HEFTER: Objection. 

(6) A: Yes, yes. 

[71 Q; And how is that? 

I«! A: Well, if the question of interest is 
I9| whether this deponent has been exposed to this 
Moi document before, that providing it visually in 
M>| front of him or her enhances his or her 
1121 understanding of what this document actually said 
(m and what it looked like, and by providing that 
[141 information which would not have been provided if. 

(isi instead, someone had simply summarized what the 
riE] document said in fewer words or described that in 
M7] terms of its visual appearance, it increases the 
[ 1 ^ likelihood that rcspxjndcnis will be accurate in 
MSI answering that question about whether they have or 
I 2 q have not seen it before. 

I 2 i| Q; In answering the question about whether 
[221 they have of have not seen that document before — 

!(23| A: Yes.That's all 1 was referring to. 

|(24| Q: My question is, docs showing a person a 

;[25l document they have never seen before aid a de[X>ncni 
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P! in remembering past events, attitudes or beliefs 
PI that arc not reflected in ihat documemi' 

MR. HEFTER: Objection 
A: That arc not reflected in that document.’ 

1^^ trying to be helpful here. 1 am 
iorry, I aji saying that 1 think that it would — 
m ir^^^^ming the document would enhance the 
|9| i^uracy of people's answers to questions about the 
, and I don't see any implications of it 
d to answering other questions that don't 
with the document^^if that's what you 

asking you whether 
membering. 
mbering what? ^ 
fembering past event: 
at are not reflected in that 

^ __ is what I — that arc 

aoi ii where I get thrown off beca 
21 ) Q: Reflected, printed, appea^in. talic^ 
li^usscd. 

1 ih^question, in other won 
sent is asl|^^“Hcrc^^ 




, that 

^^ment. 
fore," and the 



25—i: 

ffrtwbfck 

let's just say, is the Fl 
^Smokers. 

■nent’s answer to t)|^^i^on 
lent of his or her past^haviofal 
and so 1 am saying,yes, scen^g that 
would enhance the statements 

deponent's past bchaviorarcispericncc. 
r as it asks, it involvr^apjS^r 
r she has ever seen ihai^oci^cnt? 

ing questions about what a 
, a survey respondent would have done in 
ictical situation, does that present a 

noblem in survey research-' 

ER: Objection. 

the problem that it presents? 

A: It ccquiFcs respondents to make 
difFicult inferences in many situations. 

Q: Is asking those kinds of questions 
something that one should avoid in sutvey research? 
A: When one can avoid it, yes. 

Q: 1 think we've previously discussed, and 
you have agreed that leading question s should be 
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avoided. 

A: Yes 

Q: Questions that push a respondent in a 
certain direction should be avoided? 

MR. HEFTER; Objection. 

A; Yes. 

Q; Questions that suggest the answer should 
be avoided, right? 

A; I hesitate on that. You and 1 have 
discussed that phrase before and i am not sure I 
understand it,so 1 am hesitating to agree with 
that one, but 1 am with you up to there. 

Q: Have you ever heard of something called 
the fallacy of countcrfactual conditions in 
connection with survey research? 

A: Not phrased quite like that, no. 

Q; Have you heard it phrased — I may be 
not saying it correctly. 

Have you heard something like that? 

A: I can't think of a phrase — 1 mean, 1 
have heard of the word "fallacy' used, 1 have heard 
the word “countcrfactuar used.but that phrase 
doesn't connect with me. 

Q; Docs asking pieopic in surveys about 
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their future intentions present a source of bias’ 

MR. HEFTER: Objection. 

A No. 

Q: Can it be done accurately? 

A; Yes. 

Q; Does asking people about their future 
■mentions raise any issues about the validity of 
survey research? ~ 

A; No mote so than any other decision. 

Q: Can people be believed when they arc 
asked in surveys about their future inteniioiis? 

A: Yes 

Q: How do you know? 

A: Well, the principal reason is ihai 
measuremems of future intentions typically predict 
future behavior cxircmcly well, and that would be 

an example of convergent validity, just as we spoke 
about earlier today. That would give you 
confidence in all of the measurements involved, not 
only in the mcasurcmcni of the behavior involved, 
but also people's statements of their inicniions. 

In addition, people's reports of 
intentions behave in sensible ways in terms of 
factors causing them and then having other impaci 
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PI on other beliefs and attitudes, so, in fact, 

|31 intentions have been the focus of a great deal of 
[*] Study in social science. 

15) Q: How about future behavior, asking people 
^lei wh^t their future behavior is going to be, does 
£[73 thai^rcscnt a problem in survey research? 

Not uniquely, not any more so than other 
measurements, no. 

^Are there any steps that can be taken to 

maSe it more likely that those answers or responses 

g osc kinds of questions can be believed or can 
sed for making infcnlfte^s? ^ 

Yes. Everything thai^w^^^^ make a 
survey reliable and valid ^uld help in achieving 
|oal, yes. 

^What arc they, whc ^^.^ talking about 
fc behaviors? What awme^ps you can take? 

Everything we latkc^i^^^ilready: 
ng to it that question^^^^asked in a 
pi| biased way; seeing to it t^cref^ndcnis arc 
[g^^' lhMKIR ed. motivated; proi^S^l^^oiiymity.Thc 
iTi^w^l^list of everything iju^s do a good 

Pijfg^^cy. 

^ In surv ^arch. 
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rcnce between await^^^^l belief? 

: lam hesitating a littlesurvey 
, rch. but in the socia^j^^ct^. generally. 

^absolutely, there is a ^tmciiSn. 
j| What is the diffcrcifee?''™^ 

Well, awareness actually has^two 
rent meanings. One of awareness 

Ives an aspect of Der hcmaiM ^t the moment, so, 
her words, if 1 were to t^you, are you 

that somebody drtp^^^^j^icncil at the other 
of the table, that would be essentially asking 
ojj^hclhcr your conscious mind registered that 
m or were you distracted by other events 
iw^iening at the time and therefore did not 
^K^cive that event happicning at the time that it 
o^^irrcd.That's one derinition of aware. 

^^i^^cond definition of awa reness that I 
have seen in .some social science research really 
refers to remembering exposure to particular 
informaiiun. It's nut that there is a particular 
event that happens at a moment in time, like a 
pencil dropping, but rather, you could ask people. 

arc you aware that some other individuals believe 

that smoking is dangerous, and that belief is not 
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PI an event that occurred at any given moment. 

[3I although it could be revealed by events that 
HI occurred at discrete moments, but here it's really 
|s) aware is in some sense a synonym for do you know 
|6) this, do you have this piece of information. 
m Now. believing something is different, 

IB| in our literature, because, in other words, you can 
rs) be aware that the Surgeon General has said smoking 
5 i[fl is dangerous, but that docs not mean that you 
(111 necessarily believe that smoking is dangerous, that 
(121 there is this distinction between awareness that 
ii3i others have stated this and your own personal 
ini endorsement or acceptance of a fact or an 
|isi assertion. 

(ifil Is that helpful? 

1171 Q; Which docs a smoker need in order to 
l<B| make a decision about whether to continue smoking: 
ri9j Awareness that the Suigcon Gencrai and others have 
120 ) said that smoking causes disease, or belief? 
pn MR. HEFTER: Objection. 

[zai A; This brings US to territory that we were 
psi in at the end of my last deposition, which asks — 
rw) in which you asked me to make a statement about 
( 2 S) what smokers do or do not need, and it is my belief 
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Pi that, as a social science professional, I am not in 
ra a position to determine what any picrson needs or 
(4) docs not need.That can be answered in a couple of 
isi different ways. One, the individual himsetf or 
(El herself can make a determination of what he or she 
m feels that he or she must have in order to make a 
i«! decision. It is also possible to answer that 
(91 question from a legal point of view whether a 
|ici) person must or must not be piouidcd with some piece 
|iii of informaiton. But as a social scientist, I am 
li 2 l not in a position to assess whether somebody needs 
(131 or does not need a particular piece of information 
114] in order to make a decision. 

(151 Q: So if I understand your testimony 
( 1*1 correctly, you don't know whether or which ones of 
1171 (he 50 million people who have Slopped smoking in 
>1181 this country did so because they were aware or 
|i9i because they believed that cigarette smoking was 
po; bad for you; is that right? 
pi) MR. HEFTER; Objection. 

I7J1 A; Let me answer this way: 1 will answer 

P 3 i this using the word "awareness" to refer to what 1 

P4| said a moment ago, that is aware that other people 
psi have assened that smoking may be dangerous or is 
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Rl dangerous to health 

PI The research that I reviewed in my first 
(4) report focuses not on that awareness but instead 
IS) focuses on respondents’own beliefs about whether 
161 s^kinj^s or is nof dangerous lo health, and the 
[7) Judies it&t I reviewed in that report show that 
|B] b^^P^he health consequences of smoking arc 
19) f^iinary instigators of quilting smoking. 80-plus 

respondents, of people who quit smoking, 
til) a|gpcarto’do so principally because of health 

so those beliefs do appear to play a very 
in instigating quittingt^ 




opinion as well ihat'^ 

ns by others regardin^^whe^her smoking 
s not have dangcro^is-h^lt^ consequences 
nt determinants of ' 
ihcr smoking docs of ^es 
isequcnccs.They arc | 


[ 20 ) determinants, but they are ini| 
aii in pbyulg a role. 

S o^SaaBB Cforc. in my opinion,! 
aaj cauanclui^whcrc by pcp pic a 
a*) by o^^^hich th^^^ucnci 
^ in lum^^^nccs 




Uof statements 
I beliefs, 
town behavior. 


n 


Q: 
PI in o 
|4i Icadii 

Ml 
A 

m que: 
n than 

PI whe 
ini sail 
you. 

Q 

your 

M 
A: 





S—12! 
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u evaluate the de 
determine whether 
'Siions asked? 

EH: Objection. 

•not asked lo cvaluaitf the \ 

•s 

that survey, nor hav^^^m^so, other 
insti^tton during dpjwsition 

^sked me about a cotjl^^^^csiions and 
at sound like a Icadingcg^scion to 


u ask any leading questions in 
nc survey? 

ITER; Objection. 


Q: something tn the survey 

iitcra^ ^^^j^ d acquiescence bias? 

Q: Would you tcU us whai that is. 

A: Acquiescence response bias comes up in 
questions with particular sets of response choices. 
Most frequently, it's been studied with regard to 
questions that involve ai»rcc/disagfce response 
choices.That can be in a simple dichotomous ease 
where I say do you agree or disagree with the 
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following siaiemcnt. or it could be in a case where 
1 offer you a rating scale to represent degree of 
agreement or disagreement. So I might say do you 
strongly agree, somewhat agree, neither agree nor 
disagree, slightly disagree, and so on 
The second type of question is 
truc/false questions, that is questions that 
involve answer choices asking people whether they 
believe Something to be true or false 

The third category are questions where 
the implicit answer choices are yes and no, and in 
those questions, typically, we don't offer them, we 
say, did you go to the baseball game yesterday. We 
don't say, did you go to the baseball game, yes or 
no.That response understands implicitly that yes 
and no arc the answer choices there. 

for those three types of questions, a 
great deal of research has shown that a small group 
of respondents, 10 to 20 percent of respondents, 
regardless of population — apparently this shows 
up quite consistently across different 
piopulaiions — arc inclined to agree with, say true 
to. say yes to many contradictory statements. 

So, in other words, you could say, do 
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you agree or disagree ^ do you agree or disagree 1 
am mainly a fnendly person, do you agree or 
disagree I am mainly an unfriendly pcrson.Therc 
is a small group of respondents who will agree with 
both of those assertions, despite the fact that 
they appear to be opposite or opposing one another 
in character. 

AcquTescencc bias happens more under 
some conditions than others, it happens more among 
some individiiats than other individuals. 

Q: Does acquiescence bias tend to become 
more pronounced toward the end of a long interview 
than it docs at the beginning? 

MR. HEFTEH: Objection. 

A: Yes, I believe there is evidence 
consistent with that assenion. 

Q: Does acquiescence bias present more of a 
piotcntial for bias with older survey respondents 
than it does with younger survey respondents? 

A; We have to be careful about a definition 
of older versus younger. My read of the literature 
actually is that very young respondents, under the 
age of 15 and going down, actually show increases 
in acquiescence response bias, as do individuals 
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PI older than age 70, and that middle age group 
t m appiears to be the least susceptible to it, in 
|4| between, say, 20 to 65. 

[SI Q; How about between the ages of 20 and 65. 
is there a difference? 

/ [ 7 ] a| I don’t believe that the literature 
ly shows it at the moment 
Q; Is there an increased potential for 

acquiescence bias, in responding to questions 
i socially desirable behavior? 

No. 

Is there an incrcasc^Ni^k of increased 
er of acquiescence asking people 

questions about the self t^eption bias, the 

lions that have poic«fiai fd¥^elf-deception 

biaT “■ ■ 

- HEFTER: Objeetr 
No, 

:: Were any steps tak 
the deposition survey to 
R. HEFTER; Obicctii 

^s- 

What w osc St 

Again. I: e that 







ndents under oath 
likelihood of acquiesce' 
clear, with regard t: 
depositions are be: 
reduces the likclih 
rting results is the 
sides asked questio 
c deposition, where 
lions were phrased ft 
cular meaning consii 




eciion with 
uiescence bias? 


ere taken? 



attorney, tho.se agendas were in opposing 
lions, and therefore, any coders who read the 
ffirc transcript and took into account answers to 
uestions in reaching any judgment would do so 
;eping in mind the balance of acquiescence bias 
ing response in one direction at one time 
the interview and at another time, in 
another dircciinn at another time. 

Q; 1 believe you previously said that — 

MR. BLEAKLEY: Skip that. 

A: Sorry, 1 just want to be .sure there 

aren’t any other steps. 

Q: All right. 

A; No. I don’t think so. 
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Q: I think we previously discussed that, 

and you discussed earlier here this morning, there 
is what 1 will cal), whether you call it or not, 
inrcrv'iewer bias, right? 

A: 1 don’t think we discussed that yet 
today, but. okay. 

Q: There is a potential for interviewer 
bias in connection with surveys, right? 

A: Yes. 

Q; Do you think that interviewer bias was a 
problem in connection with the deposition survey? 

MR. HEFTER: Objection. 

A: Interviewer bias is, in my opinion, 
impact on the answers that people give driven by 
the hopes or cxpccuiions of a question, and 
interviewer bias can also occur not driven by that 
person's hopes or expicetations mediated by his or 
her behavior, but actually can occur simply by 
respondents observing physical characteristics of 
the interviewer, tone of voice, way of speaking, 
clothing and so on. 

Rcspiondcnts — excuse me, deponents 
certainly observed a lot about questioners in 
deposition surveys, physical gestures, ways of 
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speaking and so on, behaving, and the flexibility 
that the anorncys had in phrasing questions also 
allows for the possibility of what would be called 
interviewer bias in that sening. 

Now, again, because attorneys from both 
sides in ihe case were asking questions and 
presumably were doing so in a way that if it 
created interviewer bias would be in opposite 
directions, there is a good likelihood that that 
bias that’s present in answering any single 
question would cancel out once a coder reads and 
takes into account the entire transcript when 
coding in a particular manner. 

MR. BLEAKLEY; 'W'ani to stop for lunch? 

MR. HEFTER; That would be great. 

THE VIDEOGRAPHER: The time is 12:56 
p.m.Wc arc going off the record. 

(Luncheon recess: 12:56 p.m ) 


SPHERION DEPOSITION SERVICES Miit-U-Script® 


(35) Page 407 - Pa«e 410 


http://legacy.library.ucsf.edij/tid/Dyq07a0G/pdf .industrydocuments.ucsf.edu/docs/ryhl0001 


52434 5518 




JON A. KROSNICK 
March 12, 2001 


BLUE CROSS ANO BLUE SHIELD v. 

PHlIiP MORRIS 


S—25—1/12336 
[I] Krosnick 

J2) ARERNOON SESSION 

P) (Time noted; 2:23 p m.) 

HI JONA.KROSNICK, resumed and 
isi icsiUied as follows; 
isi t^EFTER: Before we begin. Peter, I 

m Sust wart to make the record clear that at 
w we did provide you with the 

[Si ^cum^ ts that you requested earlier this 

^MR. bIeakLEY; Welt. we arc gomg co 
s,e of them and mar^^hem as 

5 nd look at them wheoj^e a 


iTlON BY (Corn'd ) 

MR. 

rosnick, do you ihii^^^^src any 
ises in the SRBI survey?^^ ^ 

FTER; Objection. 

A: 1 am going to interpret 
ning aspects of the dcsign^f the 
stematic bias or t 
^i/fe^ntly so as eg enhai 
ching tl ^^re ncnce: 
cd. 


Pa9e 411 




fin mi 

132 ) ini 




s as 
dy that 
have been 
lue of the 
h the study 



25—1 
Kroi 

•t thinking of any at 
h^n you amended my qug 
r amendment, you 
y.What about in 

sorry, I should say a 

Tmeant to include con 
Thank you. 

Su are unable to thin 
es in the design or conduct of the SRBI 
fcfincd the way you just defined it? 

'S correct. 

3 u think there arc any weaknesses in 
»iion survey? 

1 H^T'^R; Objection. 

: clear, 1 am going to 
(i«t interpret weaknesses just the way I did a moment 
PR ago. 

7 'l I guess — you know, i had designed that 
77 ) effon to measure in those people the variables 
that arc cataloged in the coding quesiions that we 
74 ) used to analyae ihe deponents' data. 

7 S| 1 would have had a traditional survey 
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IT) interviewer not involved in the dispute with no 
PI particular bias one way or another, interview — I 
HI would have had multiple interviewers, but each 
I5J deponent would have been interviewed by one 
IS! interviewer who used the standard scl of questions 
[7] that were worded carefully to be delivered 
t8| identically to every respondent, deponent, and 1 
Pi would have worded those questions in ways different 
itoj from the way many Of the questions were worded in 
|ii| the: depositions as they occurred. 

|i7) I wouldn't have drawn the sample any 

Ii3i differently, I wouldn't have done the coding any 

|i4| differently than I did do it. 

iisi So that's the extent of it. 

tisi Q: How and why would you have worded ihc 

(171 questions differently? 

(t«i A: Well, in the approach that 1 am thinking 
|i«i of, 1 would have had only a Single questioner 
I70| asking the questions and I would have avoided what 
pi| we call unbalanced yes/no questions, which were 
[771 common in these depositions, and instead asked what 
[731 arc called balanced choice questions and 1 would 
(74| not have had the sort of improvisaiional follow-ups 
(7*1 to the descriptive questions, because, of course, 

2—14:27:46 25—*4:29:16 Pag* 414 

[ii Krosnick 

I 2 i in the depositions as they occurred, the attorneys 
PI often did follow a prescribed list of questions, 

HI predesigned, and often read them very close to the 
PI wording that was prescribed for them, but following 
Id each of those questions there was sometimes 
PI impiovisational probing questions, and that, of 
PI course, requires a certain degree of expertise that 
M the legal context brings to attorneys, but a survey 
I io| interviewer who is not particularly involved in the 
111 ) endeavor docs not necessarily have that sort of 
1171 expenisc to do that sort of probing, so I would 
11 3| have eliminated that. 
ii4) And 1 would have seen to it that each — 
psi that the script, or perhaps you would call it 
li6| questionnaire, addressed each of the, we could say 
1 17) coding questions or the topics of interest, the 

)ia) variables to be measured, so that everyone was 
ji9i asked about all of them the same way. 

)ao) Q: Why would you have done this 
pi) differently? 

(77) A: Well, frankly, that is the mode in which 

(731 I am used to working, and that’s a mode in which 

I74| most surveys are done. Again, this dcposiiion 

[75| approach is not something that’s done commonly in 
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surveys, bui thatdoesn t — i tlon'i have any 
empirical evidence to show that the quality of the 
measurements that came out of these depositions is 
any less good than the quality of measurements that 
wquid come out of my approach, but my approach is 
on^thai I am used to and I know would enhance the 
iihood that you have clear indications from 
^ch deponent on each of the matters of interest, 
lat's it. 

In connection with your work on this 
casg, have you been asked to review and analyze any 
c Other surveys that been done in 

Ith issues, surveys 




lection with smokin; 

on Awareness and belief? 

I wasn’t asked to. 1 did it b1 
you provided I 

' Yes 

Where is that? 

That's in my origin^Ycj 
Q; Putting aside Profe 
^ made any analysis 

,vc been conductcoTn 
health see 






ly own. 

I product? 


isi, have 

c other surveys 
^rSicction with smoking 
br not they 
ufytoKiatc survey 
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, conduct techniq 
Not thoroughly.The 
:oal in the review of 
was to take an appi 





I 

I': 

M 

MS] 

V 

li«l 

1191 

P'l 

pCH 


■eing that 
y evidence that 
is sort of 

|istcni with a new vi^sr-wt^ social sciences 
V, based on the concept of mc^, nx t-a, 
^-analysts. 

^cta analysis is now 
nique because large 
conducted during t 


research 
? of studies have 
years on 

topics and it is possible to kind of bring all 
sc studies together into a single analysis 
look for trends ovcrail across them, and 
wh<s n you do that, if you arc looking for trends to 
ar over a large set of studies, tt isn’t quite 
ccssary to be carefully attentive to find 

ut each of the study's methodologies. 1 
took that approach and what I found was consistency 
across these many studies that 1 looked at, and so, 
if I had seen a lot of inconsistency, that would 
hjve alerted me to perhaps I have to pay attention 
to the methods that were used to identify some 
surveys being more valuable than others, or in some 
(Mher way to understand why different studies 
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reached different conclusions. I didn’t find that. 

Therefore. I didn’t need lo do that. 

In addition, I confined my attention to 
studies that were conducted by reputable, high 
prestige survey research firms, and as a general 
rule, firms with names like Gallup arc very 
unlikely to depart from best practices as 
understood at the time of the work. So you can 
have some confidence in the quality of the work 
simply based on who did it, and so that also 
accounts for my lack of detailed analysis of the 
procedures implemented. 

Q; Is it your intention to offer any 
testimony in this case criticizing the design or 
conduct of any prior surveys’ research that has 
been done in connection with smoking and health 
other than Professor Viscusi? 

A: ] don’t have that plan at the moment, 
no. 

Q: And when 1 ask whether or not you are 
going to do any such criticism, I would include 
prior research that you. yourself, have done as 
well. 

You have no intention of criticizing any 

2—14:33:29 25—14:34:46 Pago 418 

Krosnick 

of your own prior research in the area? 

A: 1 have no plans to do that. no. 

Q: 'You look puzzled. 1 mean, you have done 
some research yourself in the area, right? 

A: Yes. 

Q: You have no intention of going back and 
looking at your research and saying. Oh, this 
research is outdated or new methodologies have been 
developed, and it isn’t valid anymore? You arc not 
going to do that? 

A; I can't say 1 am not going lo do it. 

All 1 can tell you is I don’t have plans to do it 
at the moment. 

Q: Do you consider yourself to be an expert 
in why people smoke? 

A; I have expertise in why people smoke, 
yes 

Q; Docs that mean to be an answer other 
than yes or no to the question I asked, which is 
whether or not you are an expert? I mean, I have 
an CKpenisc in baseball. lou, but 1 am not an 
expert. 

A; When you say that, what is the 
distinction in your mind? 
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PI Q: Do you have an expertise, do you have 
[3| the education, training and experience necessary to 
Ki qualify you to express expen opinions in coun 
[S| which you hold to a reasonable degree of scientific 
gq c^ftaintycand upon which you expect people to rely? 

(1) I A: Yesj 

it] people smoke’ 

|gg Yes. 

teq yg^ggi^ have written that there have been 
11 ) e^^ioital projects aimed at preventing the onset 
ge smoking in children, right? 

TER: Was there an a 

i.MR.BLeAKLEY: He nodded.? 
nc you mean yes. 

I guess I don't panic 
' writing that sentence, but I ’ 

; written that sentence 
lu remember writing 
21 ) know what social influences le^dTcTsti 
SI cnc|i^^j^csign intervention | 

?ai it’? 



A: remen 

n it. I CO 




that 


uld believe 

we 

iking can we 
to inhibit 

uld 


2—' 

Krosnick 

you agree with that 
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antisnxsking intcrvcttgs w prqg rams 
^bc talking about. assiAning ym wrote it? 
ER: Well, do you ha^c’lm'™^ 
you want to show hi^ 
iAKLEY: No. 

any ipgg^^on, 

^g intervention projecjis igat hgve been 


ones? 

. I worked on one and there arc many 
have been published in the literature, 
you reviewed them? 

ad reports of some of I hem. 
familiar with the Commit 
^ (phonetic) studies? 

X A; Not particularly by name, no. I may 
I] be — not by name. 

?) Q: Which one did you work on? 

I) A; I worked on a study that we discussed 
1 ] during my first deposition that was conducted at 
q the Harvard School of Public Health in the 1970s. 
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I2] Q; Do you regard yourself as an expert, and 
PI I asked you whether or not you regarded yourself as 
PI an expert on why people smoke Do you regard 
|S| yourself as an cxpien on a closcly-rclaied question 
lo of what causes people to uke up and continue 
[7] smoking and what causes them to stop smoking? 

[sj A: Yes. 

M Q: Have you ever heard of Donald Rubin? 

( 10 ) A: Yes. 

( 11 ) Q: Who is he? 

Ii 2 ) A; Professor of psychology. 

(131 O: Do you know him? 

Ill] A; Not persortally. 

lisi Q: Do you know his work? 

(isi A: Some of it. 

(17) Q: Do you regard him as a reputable 
(191 researcher? 
im A; Yes. 

(201 Q; Do you consider him Co be an cxpicrt in 
(?il causation? 

( 22 ) MR. HEFTER: Objection, 

1231 As it pertains to smoking and health? 

P41 MR. BLEAKLEY: No 

(»] A: i am not sure what you mean by 

2—14:36:21 25—14:39:32 Pag* 422 
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[ 2 ] causation. 

m Q: Are you familiar with Donald Rubin's 
(91 causal model? 

(5) A; No. 

IS Q: Do you know that Ilonald Rubin is an 
(7) expert witness in this case? 

I*] A; No. 

(X Q: Counsel for Empire hasn't cold you that 
(101 Donald Rubin is testifying in this case on behalf 
(III of the defendants? 

( 12 ) A: That's correct, I have not heard that. 

Ii3l Q: This is the first time you have heard 
(141 that? 

( 1 ^ A; That's correct. 

|i6l O; So you don't know what his testimony i.s 
(IT) about, what the subject matter of his testimony is? 

[i8i A; Thai's correct. 

(IS) O; Now 1 am going to turn to a completely 

(30) new subject, relative risk 

121 ] What is relative risk? 

pzi A: Relative risk is the increase in a 

R31 person's likelihood of contracting an illness, for 

(24| example, as a result of having some other feature. 

( 75 I Q; Is there a difference between relative 
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risk and absolute risk? 

A; The icrm "absolute risk" is not one that 
I am sure of a definition of. but if we defined it 
in terms of the probability of a person with a 
siiteic feature contracting an illness, for example. 
th(^. yes, relative risk would certainly be 
erent. 

Q: Explain for us the difference between 
Ig^tive risk and absolute risk as you have just 
denned it. 

Okay. So absolute risk would be 
Ipulated as the probawtily jhw a person with a 
icular characieristic^^^^^cigarcne 
kcr — will contract a partij^lar illness, for 
x^iple. let's say lung c|nc^<^ there might be. 
fo^xample.a 10 

ker will contract lun^ 
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'^Relativc risk, on the 
compares that ptobabil 
Ic without the cha 
H^tokcrs, will contract il 
e ratio two 




that a cigarenc 
during his or her 



d. 

robability that 
involved, that is 
ic illness. So it 
iiies. 


ise risl^^es a person need 


40:49 


now in order to mal 


ether to quit smoking or 



jr48 

Krosn)/ek 

il decision about 
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her to take up 





^R. HEFTEH; Ohjectit^n. 

As wc discussed last timc.'i^tional is a 
that has behind it ^greac^t eal of contentious 
le and no rcsolutioiO^^^ definition that in 
mind makes sense, st^^^^nswer questions 
t whether it would be ^latiqnai or an 
ional decision, becai^^^^^many others have 
d to define that in an adequate way and it just 
ijntn worked. 

Q: Let's change the question. Which of 

ri.sks docs a person need to know in order to 
kc a dcci-sion about whether to smoke or quit 
ki^g or take up smoking.’ 

ow that brings us back to an issue wc 
talked about before lunch, which was, am I in a 
position to make an assessment that any person 
needs any piece of information in order to make a 
decision, and my answer to that is 1 think people 
can and do make routinely make decisions frequently 
on the basis of varying amounts of information, 
sometimes none, sometimes a lot.That's a decision 
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121 lhat individuals make for themselves in terms of 

P) how much informalion they want before they make a 
PI decision and 1 don’t personally see myself, as a 
IS] social scientist, as being in a position to be 
i€t prescriptive about how much information an 
|7] individual needs or which kind of information an 
[«l individual needs in order to make a decision. 

M Perhaps by some legal standards we could 
(101 arrive at a judgment about what people do and do 
111 ] not need to know and I can certainly make 
liz] statements about accuracy or inaccuracy as 
|i3| penaining to decisions, but 1 Can't ulk about 
(141 whether a particular piece of information is 
[is) required for a person to make a decision. 

( 1*1 Q: In your repon. you conclude — and ! 

(17] think 1 am quoting directly — that the vast 
(IS) majority of American current and former smokers 
im currently underestimate the increase in risk in 
1201 getting lung cancer from smoking. 

[211 Is that your opinion? 

(221 A; 'Vcs. 

(73| Q; 'Which risk are we talking about here, 

!24| absolute risk or relative risk? 

I 2 S) A; Relative risk. 
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(21 Q; Why do you choose relative risk instead 
PI of absolute risk as the basis for this opinion? 

PI A; Well, because my opinion is based upon 
isi consideration of people's decision about what risks 
1*1 they bring to themselves as a result of smoking 
(7] that would not have been there otherwise. In other 
m words, the risk of lung cancer due to smoking needs 
m to be characterized as the increase in a person’s 
[loi risk of contracting lung cancer due to smoking 
(■t[ behavior, and so when defined in those terms, it 
(121 demands discussion and measurement of relative 
(131 risk. 

[14] Q; Is it your opinion that when picopic are 

(isi thinking about whether to quit smoking or not. what 

( 1*1 they svant to know is whal the relative risk is? 

(17) MR. HEFTER: Objection. 

( 1*1 A; I have no basis for knowing what people 
(iB| do or do not want to know in making that decision. 

1201 Q; Is it your opinion that when people make 
pil the decision to quit or not to quit, they do it 
(221 based on the relative risk of smoking? 

(23) A: I don’t have an opinion one way or 
P4| another about that. 

(251 Q: Now, in your survey, your telephone 
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survey, you found that the average respondent 
believed that 4} percent of smokers get lung 
cancer, right? 

A: I wouldn't quite phrase it that way. 1 
'^'uldif^talk about an average respondent I would 
the average of respondents was 43 

The average of respondents was 43 

smokers get lung cancer, and. in fact, 
know the numberjs far less than that, right? 

! know that, actually! am 

I see whether a icliab}c^^^^;r on that 
ars, but the numbefepma^seen so far, 
ecn fully convinced ajs cai^latcd in a 
^ould have confidei^trfl^’ ^ 

W^t numbers have you i 
TOC seen the numbers l 
i offered in his publi^ 

Q: ThOK are the only nur 
of w^t percentage of people ; 
can^^^^&are smokers? 

A^ncetKo be carefukhere. 

In Ufetin ^^a 

tfaap^p^mhers ] l^^^ecn. I; seen other 
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cancer per 



you, in developing j 
your research, iiud^jiq^eKQrT to find 
rcenugc of the people whosmokc 
their lifetimes contr^^^^^ancer? 

II people who smokcLbut sontc 
smoke, yes. 
survey, you found i 

ispondcnis belicvec^f^'T^'^rccnt of 
get lung cancer is that right? 
hcck that? 


m that, you calculated a relative 
something percent? 

xactly. I mean, relative risk was 
actually calculated respondent by respondent, not 


01 based on the means. 

t| Q: Explain what you cncan by that. 

n A: in other words. I thought the 

li implication of your question was did 1 divide 43 by 

«1 19 in order to get the mean for the sample.That 

SI i.sn't what 1 did. 
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IZ] Q: I got you 

[3{ A: 1 did it individually for each 
141 respondent using his or her ptcrccpiion of smokers 
IS! or nonsmokers and then averaged those figures 
isi across respondents. 

(71 Q: Now, in your survey, did you ask this 
[») question, that is, what percentage of lifetime 
(9) smokers get lung cancer? Did you ask ihai of 
( 10 ! nonsmokers, as well as smokers’ 

[Hi A; 1 didn't ask that of anybody. 

(171 Q: DidSRBI? 

( 13 ! A: They didn 't ask it of anybody. 

[14] □; What did you ask them? 

(isi A: K lot of things. 

|i«] Q; About what percentage of the people who 
(17) smoke get lung cancer?What was the question? 

[i>i A; 'Vou said lifetime smokers. 1 didn't 

(IS! ask — we asked about people who smoked a pack a 

TO day for 20 years. 

(71! Q: Were nonsmokers included? Were they 
(7^ asked that question as well? 

(731 A: No, they were not. 

(74] Q: Why not? 

I7sj A; I was told that this lawsuit is about 

2—14:47:38 25—14:48:44 Pag« 430 
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'■ IT] the perceptions of smokers and the health costs 
; |3i Incurred by them, and so therefore, the focus of 
I HI interest here was only current and former smokers. 

I isi Q: Your survey did include former smokers, 

(G] then? 

I (71 A; Yes, it did. 

I HI Q: Why did you ask former smokers? 

(»l A; Because I was told former smokers are of 
Moi relevance to this case. 

(II] Q: And your opinion that current and former 
(IT) smokers currently underestimate the increase in 
|i3! risks for getting lung cancer is based on the fact 
[i4[ that the average of those respondents believed that 
|i5| 43 percent get lung cancer, the average of 

(161 nonsmokers. the average respondent believed that 
[ 17 ] nonsmokers was 19 percent, right? 

[181 A: No. 

(19) Q: You expiain that. then. 

(7Tii A.: 1 am sorry, explain what? 

(7ij Q; You said no,that's not right? Alt 
(771 right, let me stan over again. 

(73] I>o you know how many people there arc 
, [74] who have quit smoking in the United States over the 
)(75j last 35 or 40 years? 
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A: No. 

Q; You have seen no daia on that at all? 

A: 1 may have. I don'l recall 
Q; Would you agree with me that it >s 
several million? 

1 have no basis for disagreeing. 

You have never seen any data that shows 
*now many people in this country have stopped 
jpip king since the Surgeon General's report in 1964’ 
I didn't say that. 

9 : Have you?* 

I said I don't recall Micther I have or 


: You have no rccoll^tion of seeing any 
^that shows how ma^y“pcGi)3fc in this country 


|i7i hal^'stopped smoking sihe^^ 
I don't have any sp^re^^^ 
have seen it. 

Is it your opinion tlS^^^^ 
pi] am going to have to ask 
r a second. 

^nt you to assume tKMnc 
illion.o 


^ Okay 


i; is that right? 
ollcction. 

1 guess I 

ike an assumption 
inumber is 
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Is it your opinion th^^^^^^^million 
r^S^ose former smokers urideustimated the risk of 
l^^emng lung cancer? 

HEFTER: Objcctio^^'H 
^ No. 

Is it your opinion that m ost^^ f them 
i^^Si^rcstiinated the risk c^^^^^lung cancer? 
HEFTER: Objcctio^^^^^^ 

Even though they 
Yes. 

Do you know why they quit? 

Many research studies show that the 
[i^mrinury reason why people quit smoking is concern 
the health effects of smoking. 

So the research shows — and you have no 
agree with it — 

I19| A: I have a lot of reason to agree with it. 

[am □: No reason 10 disagree with it? 

Bt| A: Right. 

pai Q: So the research shows that most if not 
pal all of the 50 million people who quit smoking quit 
(«l for health reasons. Nevertheless, most of them 
ps) undctestimaicd the risk of smoking? 
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| 2 | MR. HEFTER: Objection. 

PI A: Yes. 

S<I Q: Is that right, that is your opinion? 

( 5 ) A; That would be my opinion, yes. 

I 6 ] Q: If the absolute risk or baseline risk — 
f 7 i MR. BLEAKLEY: Strike that. Let me 
f<i Stan over again. 

i 19 ] Q: Is it your opinion that knowledge of the 
110 ) relative risk of risky behaviors is what people 
|n] need to know in order to make decisions? 

Ctrl MR. HEFTER: Objection. 

|iai A; As 1 said cariicr, 1 am not in a 

[u; position to make any professional assessments of 

[is( what people do or do rmt need to know. 

[> 6 | Q: Is it your opinion that people need to 
[17] know the relative risk of risk behaviors in order 
iiai not to underestimate those behaviors? 

|t 9 ] A; Yes. 

poi Q: What if the absolute or baseline risk of 
pt) a risk behavior is minuscule, less than 100 th of 1 
pzi percent? Is it your opinion that one still needs 
Pfl to know the relative risk Of that behavior in order 
p«j not to underestimate the risk? 

BS| MR. HEFTER: Objection 
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| 9 | A: Yes. 

PI Q: Did you do or have done any mutiivaricd 
Kl analyses of your survey results to distinguish 
[ 5 ] between the effects on people's relative risk 
m perceptions? 

| 7 ] MR. HEFTER: Objection, 
m A: Well, 1 am not sure what the question, 
n the latter part of the question means, but I can 
[ 10 ) tell you 1 have not done any muliivaried analyses 
iii| of those data at all, so I don't know what that, 

(121 you know, what the — what it is you arc asking 
[131 about specifically, but I can tell you no. 

(141 Q- Let's turn to your motivation to quit 

(15] index. I would like you to take a few rnomenis to 

|i«l describe what it is and why you did it. 

|i 7 ] A: Okay. As I understand it, one of the 
[i«l questions in this case is whether, if tobacco 
(IS) companies had acknowledged, beginning in the 1950s 
(TUI what they knew at that time about the fact that 
pi| smoking cigarettes did, in fact, increase chances 
(721 of people acquiring piarticular undesirable health 
[291 conditions, that people would have smoked less in 
( 2 «| this country, and pan of the purpose of the 
( 2 S 1 depx 3 siticns was to explore that question and to 
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PI supplctncni ihc evidence coming from ihosc 

PI deposiiions. 1 wanted to do an experimcni that 
i>i would test that hypothesis in a different way, and 
IS) so the experiment was designed to be done in a 
10 s^cy, lyid in the context of a single survey 

|it'5 impossible to measure the dependent 
VC would call if. that is actually of 
rherc, which is smoking behavior 
(r words, the goal of this 
ht was to expose some fjcoplc to certain 
|iz) r^^sages,^^nder certain conditions from tobacco 

mployecs and to ob|«i^ the impaa that 
iut we can't actually q^^^^lnpact on 
>king behavior during the of a survey 

what I did was to ^haw ol^social 
|i71 p^cholo^i^l theory and an ex' 

1 psychology gencrall 
such as smoking, and 
|are predicted very 
[a<; and intentions arc predicted ii 
yn emohai^cmotional reactions ti 
aai so wM^na^ted to do was to 

uses of JisBOi^ng befi 


I- 


I 
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^1 did W 2 S to measure; 



t of likelihood of quiiiinl 
In^regrct about smoking 
■usal model that the i 

m smol^^g^c more they will innfritHcrq^it smoking. 
[71 and iB^^rc they intend to qui| smokig^ the mote 
I fact, quit smoking, ^S^^^asuring 
hd intentions are the ^-M.wpmxitnaTions 
j implemented in the i^^^^^ntext to 
■ dependent variable|g^^st. 
he basts of your motivation to quit 
>u reach any conclusions? 



t^Lconclusions did you reach? 

eluded that exposure to assertions 
' causes serious health problems from 
general and tobacco company employees 
■I essentially simultaneously significantly enhances 
111 regret about smoking and desire to quit smoking, 

'M and from that. I made the inference that had people 
v) in America repeatedly heard during the 1960s that 
-at SCI of messages coming from those two sources 
«i essentially simultaneously — that is, the Surgeon 
si General saying smoking causes lung cancer and other 
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serious health problems and tobacco companies 
making those same assenions — that people would 
have smoked less. 

Q: So it is your opinion, based on this 
motivation to quit index, is that if the tobacco 
industry had made statements that smoking causes 
disease, there would be less smoking? 

A: There would have been less smoking, yes. 

Q: There would have been less smoking, 
fewer smokers, fewer cigarettes, both, which? 

A: Either or both. 

Q; Is it your opinion that there arc people 
who would have quit who didn't quit but would have 
quit if the tobacco industry had made these 
statements? 

MR. HEFTER; Can I hear that read back? 

(Record read ) 

A; Yes. 

Q: It took you a long time to answer that. 

Why? 

MR. HErfER; He was thinking. 

A: I just wanted to chink it through 
carefully. 

Q: And that's yOur opinion in this ease? 

2—14:59:22 25—15:01:18 Pag* 438 
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A: Yes. 

Q:: Is it your opinion that there are people 
who would not have taken up smoking in the first 
place if these tobacco industry statements about 
smoking had been made? 

A: I am less certain of that, because 1 
don’t have data on nonsmokers and the impact of 
this message on nonsmokers. 

Q: Docs the fact that you arc less certain 
mean that you arc net prepared to offer an opinion 
to a reasonable degree of scieniUic certainty? 

A: Correct. 

Q: So you are not going to offer ihc 
opinion in this case that the motivation-to-quit 
analysis and index you did would have affected 
smoking initiation rates^ 

A: I can’t — I am rot sure 1 can say now 
definitively that — 

Q; We are entitled to know. 

A; 1 mean. I have no plans to know. 1 am 
just saying I may have — 

Q; Speak now or forever hold your peace. 

MR. HEFTER: I don’t think that i.s 
exactly the standard, but — 
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[7| A: IT I gci to that point, I will let you 
PI know. 

Ki MR. BLEAKLEY: Pretty close 
[SI Q: You have no intention at this time of 

O ing such an opinion, correct? 

That's correct. 

Because you arc not certain about it’ 

A: ’Well, no, you — 
l^rf-HEFTER: Objection. 

^ii At — you asked me on the basis of the 
mot^tioiHO-Quit analysis. 

Yes,that’s right. , 

Right. 

ing Q': Now, is there any biwfe other than your 
^^^^^ation-to-quit analysifthai f3%ns the basis 
[ITT for^Dur opinion that pcoULg^^^d have smoked less 
tobacco industry hM^ul^hese statements? 
HEFTER: Can I 

^pleise. 

pi] (Record read) psssssssss^ 

ca ^^R. HEFTER: Qhiectiofe^^ 
la^^iA: i^erc is evidence in thcfdc(jositions 
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|dct»sitions 
l^^im that if 
these assertions, people 


Page 440 


have been less lik 
^^re is evidence in the litc 
^^^unoking in children,e 
that if tobacco c 
^^^^tments, there would less onset of 

^^%hat’s all of the evide^^^^^ ihink 


in smoking, 
on the causes 
'y.,consistent with 
had made these 


What evidence in tHclii|ciattirc is there 
^ct that such statc|^^^^madc by the 
laijt^itcco industry would affect the onset of smoking 
li^n^^ildrcn? Please identify for us every article 
i^^rKicntiflc study that has been conducted (hat 
name. 

ta The ones that I know arc all listed in 
ii^^^TCTOrt and these are — and you have to — there 
i^^^i^ics Of different kinds, but the crucial 
m ones here arc .studies documenting that beliefs 
po) about the hcallh consequences of smoking have been 
pip changing during recent decades, and so 40,50 years 
\ 22 i ago, approximately half of Americans believed that 
mt smoking was not dangerous, and that was true for 
p4l children as well 

psi Funherinore,there is evidence that 


PI children who believe health consequences, 

[31 undesirable health consequences of smoking, follow 
[4) from smoking, arc less likely to start smoking 
(tl because of those beliefs, and funhermorc, there is 
is[ evidence indicating that the Surgeon General’s 
n warnings to the public about, and other statements 
m to the public about the health consequences of 
ivi smoking were persuasive and did, in fact, aher 
(loi people’s beliefs about the health consequences of 
[o) smoking and altered smoking onset rates as well as 
[IT! quilling rates, and there is evidence from the 
[Oj attitude change literature that clearly indicates 
[«[ if tobacco companies had made those assertions, 

[isi they would have been more convincing for the 

[isi American public than when the Surgeon General nude 

[ 17 ) those assertions, and so by bringing together those 

[IS] four sets of literature, I think it’s quite 

|tq rcasorubic to conclude that had tobacco companies 
p«l made those statements, which would have been 
p<i received as especially credible, and being more 
P7i persuasive than the Surgeon General, that would 
pa[ have led more children, young adults and older 
P4) adults to recognize the health consequences of 
ps] smoking earlier, and that recognition would then 
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P! have led to less smoking onset. 

IS) Q: Did I hear jmu say that statctnenis by 

fi) the tobacco industry would be even more persuasive 

(si than statements made by the public hcalih 

(B) community? 

PI A: No. 1 said by the Sutgeon General. 

[«i 0: Sutements made by the tobacco industry 

[91 would be even more persuasive than statements made 
[ 10 ] by the Sutgeon General? 

[If] A: Thai’s correct, 

[IT) MR, BLEAKLEY; Let’s change the tape and 
ti}) pursue that. 

[14] THE VIDEOGRAPHER; The time is 3:07 
(la p.m.This completes tape number 2 of the 
(i«! videotaped deposition of Jon Krosnick. 

|17) (Discussion off the record.) 

[la; THE VtOEOGRAPHER; The time is 3 08 p.m. 

[iq and this is tape number 3 of the videotaped 
[701 deposition of Dr. Jon Krosnick. 

[2.| BY MR. BLEAKLEY: 

pz] Q: Before we changed the tape, you said 

ini that there is evidence that statements made by the 

P4| tobacco industry would be even more persuasive than 

|K| statements made by the Surgeon General, And when 1 
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jj) used the icmi public health community, you excluded 
PI that, you said. no. I mcam ihc Surgeon General. 
iai A: No. I didn't use those words, so I just 
(St wanted to clarify I said — 

Hqw have siaiemeni.s made by the 
^fendai^s.by the tobacco industry been more 
; than statements made by the Surgeon 

literature on persuasion in social 
has quite wttcnsively for a long time 
tw characteristics of the source of a 
tfluence how much ^OBiSiL^tithudes and 
.nge in response to 1 at message. 

iis{ a nd one of the findings in that 
|ici makes an assen 

|i7) his or hei^elf-interest or their 
( 1 ^ thjP^^^e And that assenion fb be es| 

(isi and especially tikcl' 

pq because certainly there is no ulj 
pii the source to be expressing it 
P 2 ) actuS hi^air ts the source in so 
laai whejP^ it wms out there act 
X| don^^inctions ^^^uigc 
23) should advi: 





2—1 

Krosnick 

General published ^^^^SF^dicating 
,t time not all Americans I^^^Kcd that 
General was compM^w^i m partial in 
actually, there was sonne skepticism about 
e Surgeon General naghi be hverly worried 
01 abou t ^a^ h issues and overly a jaggafel^ m the 
m cons^^CTCes of smoking.Thai would not be 

n rclcvl^^^hc tobacco industry the same 

cause it would be &ard|lo iqnagine 
cco industry woulc^^^^^tatemcnt 
own self-interest unless it had 
research suggests, 
your expen opinion that there was 
time in which a significant number of 
n people believed that the Surgeon 
Qvcriy concerned about smoking and 
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iq ai 
iii that 
>31 again: 
iq valid! 
M| Q 
isj a pci 
■q the A 
171 Gene 


iq health 
iq MR. HEFTER: Objection. 

<q A: No. 

!i| Q: Do you think this is true today? 

•t) A: What is true today’ 
q Q: That staicmcnis made by ihc tobacco 
■4] industry arc even more persuasive than statements 
■S) made by the Surgeon General? 
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MR. HEFTER: Objeciion 

A: I am less cenain about that. 

Q: Why? Why would there be a difference? 

A: Well, of course, during the last year, 
the tobacco industry has, in fact, made ihc.se 
assertions in public, and there is a new 
explanation that was presented to the public very 
vividly at the time that these assertions were 
made That is,that the tobacco industry saw 
itself. I believe, in Florida,as in serious danger 
of losing a very large scale lawsuit after having 
already settled with states’ attorneys general 
across the U.S. and revolutionary changes in 
acknowledgements about tobaccos, risks and 
responsibility of tobacco companies, and so ihere 
was at that time widely publicized the notion that 
tobacco companies were changing what they were 
saying, not necessarily because they genuinely 
changed their beliefs about the matter, but rather 
because it was an opportunistic thing to do to 
mitiimizc financial liability, and if that was 
presented in the context of ongoing lawsuits may 
have altered this sequence. 

Q: Wbat do you mean, may have alicrcd this 

2—15:11:41 2S—15:12 37 Pag« 446 
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sequence? 

A: That people may not have been as 
convinced by those assertions if viewed in 
isolation. 

O: Let me make sure I understand this. 

What you ate saying is that if the 

tobacco industry had said, let us say. in 1964. 

that cigarette smoking causes lung cancer, it would 

have been even more persuasive than the Surgeon 

General saying it, because it was against their 

self-interest? 

A: That's correct. 

Q: But you arc not at all sure that the 
acknowledgements that the tobacco industry has made 
in (he last year or two have had any such effect 
because they were done as a part of lawsuits? 

A: No, 1 didn’t say they would not have any 
Such effect. lam saying they would not 
necessarily have as strong an effect. 

Q; Do you have any empirical evidence to 
support that or is that just a suspicion? 

A: That is just a suspicion, yes. 

Q. So this is not something you will 
testify to as an expert to a reasonable degree of 
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, scientific ccnainty? 

,a) MR. HEFTER: Objection. 

HI A; 1 can't make statements about what 1 
[il will or will not testify to in this ease. 

|t| Q; Do you hold that to a reasonable degree 
eicniific certainty? 

HH. HEFTER; Define what "that" is 
"Q: That statements made in the past year 
a.\!c not had and will not have a significant impact 
copic's quining. 

I definitely would not make that 
Lion. 

Or that it would bc.r^^^^rc — that 
statements have bt^^more persuasive than 
picnis made by the ^irgeo'l^cncral. 

. HEFTER: The ones in^e ^st year? 

>R. BLEAKLEY: Yes. 

1 am less clear aboui 
l|; 1 am only asking if 
tail opinion. 

A; I am trying to unde^ 
p^^^Sfewhat. ^ 

we c ^^^ ing rei 
su^ments tt^Hjdh sute 


Pa9e 44 7 





^an expert 

^ opinion 

9 CCO industry 
iritTBy the Surgeon 


^3:33 
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ther the 
ly the tobacco 


eral made when? 

KR. BLEAKLEY: I will stf 
tion. 

Do you have an opi^ 

|incnts that have bee^ 

Listry in the last year or two w^rc motivated 
(^^^i^rily by litigation? 

No. 

You don't have an way or the 

Now. when you said that statements made 
lie tobacco industry would be even more 
cniuasive than statements made by the Surgeon 
bral, arc you talking about statements made by 
|urgeon General of the United States onlyl* 

CS-When I am talking about the 
I'tj Surgeon Gcncial, I am talking about the Surgeon 
pq Ocncral- 

pij Q; What about statements made by the 

pai American Cancer Society, did you take those into 

(73) acctJunl? 

R4) A: Into account when, in what? 
l»i Q: Did you take those into account in 
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j 171 reaching (he opinion that statements made by the 

! [31 tobacco industry would have more impact than 
[4] statements made by the Surgeon General, or is your 
(61 opinion limited only to a compxarison between 
i [SI statements made by the tobacco industry and 
m statements made by the attorney general? 

|B| MR. HEFTER; Surgeon General? 

[SI Q; Surgeon General. 

[ 10 ] A; My statement is about the relative 
( 11 J persuasiveness of statements made by tobacco 
Ii7l industry employees versus statements made by the 
[131 Surgeon General. In making that statement, I took 
(i4i into account the fact that other organizations, 

I IS) including public health organizations, made similar 
| 1 E 1 statements. 

(17) Q; Did your motivation to-quit analysis 

(i«] take into account statements made by public health 

(>q organizations other than the Surgeon General? 

poi A: By motivaiion-to-quit analysis, you arc 

pil referring to what 1 did in the SRBI survey? 

[27) Q; In part, yes. 

[73] A: Okay. What else is included? 

[74| Q: Did it? 

[75i A: There is no mention in that survey of 

2—15:15:40 25—15 16:43 Page 450 
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PI other sources of information, but answers that 

[31 people gave in that survey may have been influenced 

HI by statements made by other sources of information. 

(SI 0; Your motivation-to-quit analysis, as 1 

|61 understand it, and you correct me if I am wrong, 

(71 talks about statements made by the Suigeon General 
(SI of the United States. It docs not talk about 
(s) statements made by other public health 
(iq organizations about smoking and health; is that 
[111 right? 

[17] A: Well.an analysis doesn't talk about 

(13) someching, but if what you arc asking is did the 

[14) survey respondents in the SRBI survey hear quotes 
|i5| from anybody other than the Surgeon General and 
Ii6) tobacco industry employees, the answer is no. 
jiTi Q: You know, however, that there arc such 
[111 statements, do you not’ 

MS) A: What statements? 

[201 Q: Statements about smoking and health made 
pij by public hcatih organizations other than the 
ITT) Surgeon General of the United States 

173) A; Yes. 

174) Q; Have you made any kind of systematic 
P5[ review or analysis Of the efforts of the public 
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P) health community oihenhan the Surgeon General to 

PI discourage smoking in this country? 

PI A: To some degree, yes. 

I 5 I Q: Did you not consider that important in 
[«} t^^duraing your motivation-to-quit analysis? 
j7) A: Th^'s correct, 

M did not think it important for there 

n a foir and accurate comparison of the 

1'°* made by the tobacco industry versus the 

( 11 ] ^»^neras made by the public health community? 

[R. ygFTEH: Objection 

ieve that there svas a 
n in the study. 1 am, 

:d about fair compari: 

c the comparisons 
ibnnaire did not invo 
public health organizations 
icneral. 
not? 

pi] A; The interest that 1 had in f{iis"stud: 
pat wa^^te^ing at the impact oi 
pai tob^^^CWipanics on currentand|fo 
^ui smok^^P^l dcsii 
l^nc. w 




hdid a great 
' fair, but 
ention of 
bsidcs the 




125—1 

Krospick 

cd in relative isolaiio 
[figments from tobacco exec 
I happened for a chu 
(51 pub^luv^lOOO who read the and heard 

Id abni^^hi^r adrnissions as they were n^Jc, or in the 
identical assertions credible 

Ith authority, and so 1 
that public health au 
iigeon General.in thdroi^xt^of this 
It, as representative public 

orilics. 




■ words, 1 believe that if 
or example, from the American Cancer 
I been inserted into this expicriment in 
^e quotes from the Surgeon General that 
\ tipat comparable results or even more 
Suits would have been obtained with 
19) regard to the conclusions that I reached, 
m Q: But you don't know that? 

Ml A: Thai’s correct. 

■ 2 ) Q; What if you had included in your 
•Ji analysis statements rnadc by the American Cancer 
*1 Society in addition, not in place of, the 
S) statements made by the Surgeon General? What 
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13) impact would that have had on your 
PI rTKitivation-lo-quit analysis? 

PI A: We would have to say in addition for 
IS) whom. 

Id Q: How many Statements by the Surgeon 

01 General were shown to the respondents in your 
is| survey? 

(91 A: Well, nothing was shown to the 
(101 respondents in the survcy.They heard them over 
( 11 ] the phone There were two groups of respondents 
(121 who heard statements by the Surgeon General. 

(131 Q: How many Surgeon General statements were 
Ii4j heard by the respondents’ 

( 1 S 1 A: For half of the respondents, zero, and 
|i6i for the other half, three. 

(171 Q'- Thiec. Let's assume that instead of 

[iBI three, you had heard three from the Surgeon 

[iBi General, three from the American Cancer Society, 

[201 three from textbooks that the survey respondents 
( 21 ] read and learned about, when they were in school, 

(221 three from the American Hcan Association, three 
(231 from the American Lung Association, three from the 

(24) World Health Organization. 

(25) What effect, if any, do you think it _ 


I'l 
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12 ] would have had on your motivation-toquit analysis? 
(31 MR. HEFTER: Objection. 

(ti A: I think it would have reversed the 
IS) effects. 

(Ej Q: Let me ask you a little bit about the , 

[7) methodology in the moiivation-io-quit analysis. 

(91 Is this — lam not going to be using 

I9| the right term, but is this an accepted format or 

( 10 ) methodology, is it something that’s found in the 

[ 11 ] literature, how to do this kind of thing? 

(121 A: I am sorry, how to do what? 

(131 Q; The motivation-ioquit analysis, the 
(v<i motivaiion-toquit index. 

A: Everything about that experiment is 
|i 51 standard practice and has been published dozen.* of 
II7] limes in reputable journals. 

|t«i Q; What journals, for example? 

ii9i A: American Political Science Review, 

[ 20 | American Journal of Political Scicnce.Thc Journal 
1211 of Personality and Social Psychology,The Journal 
1221 of Experimental Social Psychology, Public Opinion 
(23) Quarterly and others. 

( 2 *; Q: Whose idea was it to do this 
[251 motivation-io-quit analysis? 
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A: Mine. 

Q: You weren't asked to bo it by counsel 
for Empire? 

A; That’s conect. 

S?' Q:<^am sure you discussed it with counsel, 
howe^r. 


Q; Did you think about or talk about doing 
gj^M^^ysis of whether or not fewer people would 
have sinuked if d.pfcndants had said nothing about 

2 |ig and health? 

5 HEFTER: Objection, hv 
|think 1 understand 

.asking. You arc saying noth^ instead of what the 


industry did say, w|fltb 
cvidralre which is conclusik^^ 
^^^^orreci. 

am sorry, one more 
Q^Did you think about 
analyzed whether or not 
i^i^ihc tobacco industry^M^ 
^^whsi^hey said? f™™!* 


f HEFTEF 


there is not 


^udy that 
^uld have snxrked 
Sluing instead 



A; As 1 answered earlier, 1 don't believe 

that I or other researchers are in a position, 
without empirical tc«s, to determine whether or 
not an item is or is not susceptible to that simply 
by looking at it. 

Q; So you have no opinion one way or the 
other about that? 

A: That’s correct. 

Q: Is it suggestive? 

A; No. 

Q; Is it leading’ 

A; No, 

Q; Docs it implicate the scif-dcccption 
bias? 

A: 1 don’t know of any research which has 
ever tried to assess that issue directly, so I 
wouldn’t know how — 1 certainly wouldn't know how 
to assess it by looking at it on the surface. 

Q: Is it a question that will result in a 
certain number of people answering the question 
that they arc unhappy without even thinking about 
the second pan of the question? 

A: The way interviewers read questions over 
the telephone, they typically read directly through 
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Page 458 


Ifaractcrizcs the repor 
'No. 

jDne of the questions 



pne of the questionsasked in 
^.^notivation-toquit an^ptS'’’KiS$ when you think 
) your .smoking in ihe^0fsr:etec5 that make you 
nhappy or dues that pot makj you feel 

|,py, 

1 don’t think that's 
jng. Should we chccIfitOT^S?? 


U!) are missing a coiiplc of words there. 

want me to read it to you — 
luj^rQi I will read it to you. 

I'si^^^t'hcn you think about having smrkcd 
I'si ^^rarettes ifj the past, does that make you feel 
I'Tipnnmpy at all or does it not nrukc you feel 

ti»l All right? 
poi A: Yes. 

pit 0; Anything wrung with that question? 

A: Wning? 1 am not sure what you mean by 
j»i 'wrong, ■ hut — 

tari Q; l>ocs it violate or does it implicate the 
i»i social desirability bias? 


SPHERION DEPOSITION SERVICES 


the question and so lespondcnrs very larciy, for a 
question like this, will interrupt before the 
question is out, so 1 think it is very unlikely. 

Q; Docs unhappy, the word “unhappy,” have 
the same meaning for everybody? 

A: No. 

Q: It is a qualitative resftonse, isn't it? * 

A; It is a word that, just like every other 
word, has multiple inccrprciatjoris, and survey, 
respondents interpret words with different 
meanings, just as we all do. 

O: But when I say it makes me unhappy, it 
may be something very different from what you say 
makes you unhappy. 

A: Probably not very different, but maybe 
somewhat different. 

Q; But in your opinion, this question is 
not suggestive or leading? 

A: Correct. 

Q: Did you calculate a inotivation-to-quit 
index for former smokers? 

A. No,because they have quit already. 

Q; There would be no need and no sense in 
conducting and calculating a motivation-to-quit 
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PI index for people who have already been sufficienily 
PI motivated lo quit, right? 

PI A: Well, that's not exactly true This 
(SI survey for those individuals incasured regret about 
R sn^ing^ou couldn't measure desire to quit in 
(7) tlR futurcV^t^usc they arc not smoking now. You 
m c^tfdaaBMsure desire to not smoke in the future, 
.vthat's what we did. 

ss. just to be clear, 1 think 
Ing the tcrtn-''motivation to quit" as it 
here as a kind of mnemonic to describe 
gnd former smokers 
|ing that index. It's j 
cd on only two questions, 
y^rc they included in 
A: Became their beliefs aboui 
Fconclusions. 

I 

L* It is interesting to see the ej 
»ii which these individuals'beliefs 
rai smokm teiKg influenced by state 
?ai indus^%be(^>sc they could al 
Ml agatn|j^^^ here w^^^lookin 
Si bctaditetoc'would b#^igSiulato 


Pago 4 59 



ut th^ir 

I the tobacco 
rt^smoking 
ensc, 
inters 


2—U 


Z| 

31 

4| 

q 





15 

Krosni 
tion of smoking, an 
cry much of relevance to .fl^ casc 
you think the likc^S^mp iKthat 
itial number of foimc ^smokera would say 
grcl their smoking mSIilw^n they 

ER: Objection, 
the answer to that I 
fonner smokers if i 
ed 

was the point of asking them’ 

Id this index. 

idn’t just know they regretted ti? 

, and it turns out that some of 
gret it. 

^sk former smokers if they had 
f restaaing? 
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V) 

fzi from 
ihcrcfj 
W Q: 
isj any s 
R they 
(71 smoki 
R MR 
M A 
q SI 

i| havini 
Q 
A: 

Q; 

A; I, 
q them 
h Q; 

q any inti 
q A: No, 

q Q: Did you ask them any questions designed 
■I to elicit whether or not they were giving any 
n consideration whatsoever to restarting smoking? 
q A; Not directly. 

It Q: Did you indirectly? 

a A; I believe that these questions about 


I’l 

PI 

PI 

w 

IS] 
R 
PI 
PI 
I PI 
11'01 
jl"l 
I'h 

|T3| 

t'‘l 
t1SI 
I'd 
I'T] 
('« 
I'91 

ROl 

P'l 

pn 

1?3| 

p») 

PS) 


['1 

PI 

Pi 

M 

(SI 

W 

PI 

[«t 

PI 

|iq 

("1 

I'n 

|I3| 

1 ' 4 ! 

I<9| 

MS! 

nn 

I'm 

t'»i 

pot 

R'l 

P7t 

ITS) 

R‘) 

1JS| 


2—15:30 49 2S—15:32 08 Pag« 461 

Krosnick 

regret of smoking and unhappiness arc likely lo be 
precursors to determinants of whether former 
smokers would consider and initiate smoking again. 

Q; And that's what makes it relevant to 
your motivation-to-quit analysis? 

A; That's correct. 

Q: I am having some difficulty in 
undersunding how it's appropriate to ask some 
people two questions, some people three questions, 
some people four questions, and to lump it 
altogether 

How do you justify that? 

A: I guess 1 would answer that in two ways. 

One is that 1 have done analyses that you have that 
do not lump them together and that analyse the rwo 
groups separately, and the two groups yield the 
same results, one group with the dependent variable 
based on four measures, the other group with the 
dependent variable based on two measures, and in 
light of that, the most parsimonious way to present 
the results,given there is not a strong indication 
for them to vary anyhow, is to combine the two 
groups together. 

Now. the logic is these are four 

2-15:32:13 25—15:33:16 Page 462 
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measures all on the same scale, ranging from I to 
5, where 1 is the most regret and greatest 
likelihood of quitting and ^ is the least regret, 
least likelihood of quitting, and in order to put 
people on that copiinuum, 1 did it with two 
questions for former smokers and added the two 
additiona] questions for current smokers because 1 
could reasonably ask those people those questions, 
they would be meaningful for them, and asking those 
two additional questions would enhance the quality 
of the measurement of the variable that I eared 
about for that group, and unfonunatcly, I couldn't 
ask those comparable questions of people who had 
already quit, and so I accepted less measurement 
precision in that case. 

As it turns out, the reduction in 
measurement precision did not compromise the 
design's ability to detect sutistically 
significant effects of manipulation. 

Q: Did you calculate a motivaiion-io-quit 
index just for current smokers? 

A: Yes 

Q: ■'X'hai were the results? 

A: You have them, they arc — 
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Q; You tell me 

A; It shows the same results that we have 
seen here. 

Q: Now, as I understand it. you had four 
groups here, one you called your control group, 
pc^le who were exposed to nothing, right? 

S; Well, no quotes, right. 

Q: The scKcalled Surgeon General group or 
l^roup that were exposed to the three Surgeon 
General statements; the tobacco group, you called 
,itJ6^bacco group, and thc.group in which you asked 
; fwo. the combined gi6bp,iogcthcr. 
ct me go back for a the 

sis. the smoker-only analysis, the calculation 


motivation-to-quit 
ii7i th^what wc just got he 

No. You had this since 
^^^^g^ery of materials fro: 

(JO) Oh Explain to u.s why 
control and Surgeon GenlSTa 
of doing them sepaj 
hd controlling them^Co 
; The fir^^^sis th; 
at whci^S^^aring 




smokers, is 
the lunch break? 
:ry first 
ng time ago, 
ined the 
p.'W hat is the 
ou were going to 
ng them, I mean, 
s to 

quotes from the 



Pag« 464 


Krosnu 

^con General alone eil 
^ivation-toquic index as 
^p.To me, that — 1 dij^^^expect to find a 
3i?if^rencc there becauseNhc Sui^on General’s 

nents and opinions inSTcvelVsotne of these quotes 
: been very, very wirieiy nnhlfriy.rd Indeed, 

’^’Eof the quotes has bc^^^^iny cigarenc 

icages, so these curret^^H^mer smokers had 
^ them many times. SO ih J idc^ that new 
^surc to those quotc^PIPlI^ in the survey 
aid alter people's beliefs seemed very unlikely 
le. so 1 began by testing that difference, and 
3S"cxpecicd, that difference was not statistically 
ificant. 

^in other words, I viewed those two 

as essentially being comparable, that the 
^i^^lation I did to one did not produce an effect 
that was reliable.Therefore, those two groups 
essentially come from the same population, and it’s 
reasonable lo combine the two of them together in 
order to produce the highest statistical power that 
one can obtain m moving forward with other 
comparisons. 

Now, Jet me also mention that 1 have. 
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since my original report, and in the materials you 
were given today, done this analysis differently, 
where 1 didn't combine those two groups and simply 
compared the control group to each of the other 
groups, and in that context compared the control 
group to the SGTB group, that is the founh group 
that heard all six quotes, and the difference 
between those two groups is, again, highly 
statistically significant in that analysis. 

Q; The difference between which groups? 

A; The control group and the SGTB group, 
who heard all six quotes. 

In other words, the same conclusion is 
reached, regardless of whether wc combine the first 
two groups to compare with the fourth or simply 
keep them separate. 

Qi Let me ask you this: Why did you do the 
control group and the Surgeon General group 
scpiaraicly if your assumption alt along was that 
there basically wasn't any difference between the 
two? 

A; It was my exjjectation that there would 
not be a difference between the two, but that 
wasn't an assumpition that 1 made, it was an 
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expectation and I wanted to test that expectation 

Q: And your icstiniony is that this new 
analysis which was provided to us at 1:20 this 
afternoon — 

MR. WILLIAMS: 2:20 

Q: — 2;20 this afternoon — 

MR. HEFTER; stipulated. 

Q: — makes a comparison between the 
control group and the burgeon General group or is 
it the control group and the tobacco group and the 
control group and the SGTB group, which? 

A: All. 

Q; All of them, and you find a statistical 
significance between all three, in all three cases? 

A: It is all done in the context of a 
single analysis of variance, the analysis of 
variance shows overall a statistically significant 
effect of the inaniputalion. and furthermore, that 
is followed up by what you might call pairwise 
comparisons among the conditions, and what it shows 
is the first condition, mean motivation-toquit 
index score, is significantly different from the 
fourth condition, mean motivation to quit score. 

Q: Did you make a separate analysis either 
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before or in the rmieruls that you gave us today 
to see whether there was a sutisiical — 
staiisticaliy signiTicant difference between the 
Surgeon General group and the tobacco group? 

|Cl: AndVhai was ihc answer? 

is no — the difference between 
tl^MC conditions is not sutisticaily significant. 

‘ ju do that before today or today? 

STBcforc today. 

..Did^ou, before today, make an analysis 
o Terence between the ^^gcga^ffcral group 

a group? 




id you find? 
groups are not stati| 
different from one knotherj 
ou make an analysis i 
Tcrencc'between the tohacci 



d the SGTB 
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lose groups are not: 

’nil)^iffcrent fro^ one a|y&^r. j 
n’t the ^ ^^ ^ riate 

c Surgec^^^cral the SGTB 

isi 

Krosiyck 

'urposes of the opini< 
n this ease, why isn't 

?lklhcy are — 1 would siy there is 
ng as a right analysis or a wr^g 
ere arc different analj 
ormative, and whai 
id prefer, find more 
an analysis that comi 
her comes from tw( 

in whth expectations believing 
;con General's messages were widely 
eti. there would be no news there, that 
not a difference between those two 
that was obtained, and in addition, one 
alwa)^ ^ife t o have maximum statistical power in 
doing^^^^nysis because there is always the 
potentia] that a teal difference is present in an 
experimem, for example, like this, but one docs 
not have sufficient power to detect it.Therefore, 
the larger the sample, as long as the sample is 
collected according to sensible, prescribed 
principles, holding everything else constant, 
larger sample yields more statistical power to 
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accurately conclude whether an effect is or is not 
present in an experiment, and so therefore, in a 
context in which there was Strong theory in advance 
suggesting these two groups would be identical, and 
evidence that, in faa. they were not reliably 
different, it enhances statistical power and the 
chances of accuracy of dctcaing an effect to 
combine them in a comparison with the fourth group 

Q; Was the goal of this experiment to 
compare the actual world to a hypothetical world 
where the tobacco company made these statements 
about smoking and health? 

A: No. 

Q: I guess what I am having difficulty 
understanding is the hypothesis that you were 
testing or the, what you wanted to find out here 
was if the tobacco companies years ago had said 
smoking causes disease, would that have reduced 
smoking, right? 

A Yes. 

Q: Now. isn’t the proper way, assuming that 
this motivation-tc^quit kind of analysis has any 
validity to it at all, isn’t the proper way to do 
that to compare what peo ple actually heard, which _ 
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is the Surgeon General's statcmcnis, according to 
whai you have just said, with the world in which 
they heard that and the tobacco industry 
staiements? 

MR. HEFTER: Objection. 

A: 1 am sorry, J am having a linlc trouble 
concentrating with the distraction. Can we wait 
until you are done? 

Q -, If the purpose of this experiment was to 
determine, if possible, whether statements made by 
the tobacco industry that smoking causes disease 
years ago would have irnpacicd on the amount of 
smoking, would have reduced smoking, isn’i the 
proper way to do that to compare what people really 
heard, which is the Surgeon General’s sraiements, 
right? 

MR. HEFTER: And your clients’ own 
swtements as wcll. 

MR. BLEAKLEY; No. I will ask the 
questions. When yOur turn comes, you can 
ask your question. 

MR. HEFTER: 1 object to the unfair 
hypiothciical. 

Q: — to ask what they heard from the 
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Surgeon General ind compare it to what they heard 

fmm the Surgeon Gcncrai and the tobacco companies. 

MR. MEFTER: Objection 
A: That would not be my opinion, no 
So the fact that there was no 
statistical significance,statistically significant 
^ll^rence between the Surgeon General group and 
Ae SGTB group is irrelevant to you? 

HEFTER; Objection. 

A? It is not irrejevani to me. 

Isn't it a fact that if you — when you 
I'l combine the contirlhKtjjup ?nd the Surgeon 




rai group, the study j 
tficant differences? 
hat is not true. 

But you do agree wi 
icalty signiTicanc difi 
p and the TB group. 
M That's correct, 

O: And there is no stat 
leant difference beti 
up? 

That's 

And thtgSt^^o stati 





siatisiically 


cre IS no 
ictween the SG 


SG group and the 


fcrcncc 
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n^ the control 

and make the 

ieally 


sups 


veen the TB and the 
Thai’s correct. 

It is only when you 
Spp and the Surgeon 
|l|>arison that you 
Ijificant difference, rig^t? 

That is not true. 

F: In fact, arc the SC a 

^licat in terms of the ^ii|ik^ significance? 
i'l they the same, thc^^g^^^liffcrcncc at 
iJTicrc is not just not a statistically 
ficant difference, there is no difference? 
ilR. HEFTER: Objection. 

That is riot true. 

I: If you wanted more statistical power, I 
: »as the term you used, why didn't you simply 
control group hear the three Surgeon 
it»i General statements, too’ 

I50| A; Hearing .suicmems would have nothing to 
121 ] do with .siati.slical ptjwrr 

psj Q: The three Staicmcms made by the Surgeon 
1231 General, these arc the three statements made in the 
real world, aren't they? 

JTSI A; They are three of the statements that 
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|7| the Surgeon General has, in £ja, made. 

PI Q: That's right.There arc more, but you 
HI only exposed the respondents to three? 

151 A: Yes. 

161 Q: They were made in the real world. Why 
PI isn't the Surgeon General group therefore the 
m projjcr group to compare to the SGTB group? Would 
l$t you explain that for us? 
pi)) A: Yes. J answered that once before. I am 
rii[ happy to answer it again, 
nn Q: You said there wasn’t, but you didn’t 
ii.ti tell us why. 

(ni A; 1 thought I had. 1 will try to. 

|is| So the question here is does hearing 
(■61 information from one source alone produce attitude 
im change or belief change or regret change or 
[ 16 ] intention to quit change and does hearing 
im information from two sources with different 
120 ) motivations simultaneously produce attitude change, 
pi| belief change, regret change, intent change,and so 
|z?i the design of this experiment is tailored to that 

[zst question. 

In other words, some respondents, the 
I7S| control respondents arc exposed to nothing. Others 
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S2] arc exposed to quotes only from one source, still 
p) others are exposed to quotes from two sources 
HI simultaneously, and my interest was in 
[S) understanding the synergy that occurs when 
m respondents hear quotes from two diffcient 
m sources — in this case, the Surgeon General and 
l>i tobacco companies simultaneously — and so 
PI comparisons of relevance to answering that question 
( 11 ^ demand the design that we implemented. 
lii| In other words, if everybody hears 
im quotes, you have no baseline to assess the impact 
1131 of those quotes against. 

I«i Q; If that's true, if the motive of the 

ti5| messenger is important, then why isn't there any 

114) difference betweert the SG andTB grouF»? 

(17) A; Well, my belief about why there is no 

iiai difference between those two groups is that, in 

119) fact, those arc analo^cs to. in a way, not 

poi perfectly, but in a way, what has happened 

IJi) historically, that in the 1960s, the Surgeon 

j 22 ) General’s voice, I believe, was louder than 

123) tobacco's voice in saying smoking is a health risk. 

[24] There were certainly no messages firom tobacco at 
ps) that lime saying that smoking is a health risk. 
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PI Ther, in 2000, when the Florida events and so on 
PI unfolded, tobacco essentially by itself received 
PI media anention making assertions that smoking 
(St causes health problems, as well as in 

a^cnis^ents purchased by the tobacco industry in 
spapers and so on. 

SG group is in some ways, not 
I8| |^rfe«ly, analogous to the 1960s and the TB group 
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igcs had been inclui 
ipncial, then we would ha 
iually happened in th 
y^didn’t you do that? 
cross my mind. 

R-- Could wt take 


»KLEY: Sure - 
OGRAPHER: The lir gie il j jg 
are going off the 
taken.) 

OGRAPHER; The time iS'Ll3 p.m 
re back on the record. 

BY MR. BLEAKLEY; 

Id you turn in your report to 
34. 

on page 34 includes some of 
il the questions you asked as pan of the 
□I tnotivaiion-to-quit analysis, right’ 

I) A; Yes. 

21 Q: And you ask such questions as how much 
3) do you regret having started to smoke; a great 
•1 deal, quite a bit, somewhat, or a little. How 
s) unhappy does h make you feel; extremely unhappy. 
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PI Those arc what arc referred to in the 
Pi survey literature as ordinal questions or 
|4| variables, aren't they? 

IS) A: They can be treated either as ordinal or 
lei as interval. 

PI Q; They are not numeric, however, arc they? 

I8i A: I am not sure what you mean by numeric. 

IBI 0: Let me ask you this: E>o ordinal 
inj| questions — or what was the other term you used? 

||ii) A: Interval. 

iiai Q: — interval questions have numeric 

|)ai ptopcnics so it is reasonable to assume that the 

[14] differences between answers are the same? 

1151 A: Response scales of this sort are 

[leg analyzablc in light of a very large literature that 
ur] has quantified the meanings of terms like this, and 
[IS! that quantification partly informed my selection of 

[ 1*1 these fcspionsc choices and partly informed my 
n?D| analysis of them. 

pi) So, in other words, your question is arc 

[22] the gaps between these answer choices conceptually 

p3) equal to one another, and the answer is that, yes, 

p«! there is a very Urge body of literature that 

( 2 S] quantifies the meanings of th ese terms that led me _ 

2—16:15:00 25—16:16:00 Pag* 478 

[ I ] Krosnick 

PI to select terms that have approximate equal space 
[31 between them and that also jusiifies the numeric 
|4) codings that I used in the analysis. 

(5) Q: 'When you ask somebody whether or not 
1*1 they regret having sianed to smoke (bgarettes and 
P) they answer a great deal, quite a bit, somewhat or 
is) a little, people don’t mean the same thing when 
m they use those answers, do they? 

[lot A; Well, each of those answers means 

[ II ) something different from each of the other answers. 

[I?! Q: And when I say a great deal, it rnay mean 

( 13 ) something very different from what you mean when 
n») you say a great deal; is that right’ 

[15] MR. HEFTER; CSiicction. 

|isj A: It may mean something slightly 

(171 different, yes, and part of this very Urge 

[ 1 *] literature I am referring to documents the feet 

( 1*1 that when you have a scale like this with five 

pot choices, the disagreement between people in their 

pi| interpretations of the meanings of these scale 

p?l point Options is small enough not to compromise the 

p3l validity of the measure. 

I24l Q; And when you ask somebody whether they 
PS) arc extremely happy, unhappy, very unhappy. 
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Krosnick 

somewhat unhappy or slightly unhappy, you and I may 

answer those questions very differently; isn’t that 
right? 

MR. HEFTER; Objection. 

; It seemed (o me you were trying to read 
thi^but you didn't quite read it correctly here 
is 

1 think, if J understand the question, 
d two jjcoplc interpret a phrase like extremely 
ppy slightly different from each other, yes, 
could. 

: Well. 1 guess the ptjhhtyl ^ am g ening at 
cn you decide to u^^j^^Mwers to these 
questions in your analysi^isn't it appropriate to 

c median instead c^hc,n^n in representing 
ihi^ivcragc response tha^ 

"1 No. 

No, it isn’t? 

No, it isn't. 

Did you do that? 

No. 

n't it a fact that if 
ian insteaa^^hc m 




tically si. 



nt dif 






6:S4 


I have no idea, and 
ian u.scd in an analysis 
You have never see 
!y 2 ing answers to ord 
I have never seen a | 
sis of an experimen t whete^ ilfercnt 
indents at«ub}ectc|^^®crcnt conditions 
3nc is assessing the those 

n.s on an Qutc:onv| variable.The reason 
; that the median is powerful 

Sstic for use in these circumsta'hccs.and it is 
kc^ to understate differences between 
idiiions. so it's essentially never done. 

: So you think there is nothing wrong 
^^^a^soever with your having used the mean rather 
^the median? 
jrreci. 

O: Indeed, you think it is the right way to 
do it and using the median would be the wrong way 
to do it? 

A: 1 personally would not use words like 
right and wrong, hut 1 am saying it is very, very 
common to do it the way 1 did it. I have never 
heard of anybody doing it with the median, and I 
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HI Krosnick 

a see distina disadvantages to using the median that 
P) could lead to misleading conclusions of the 
HI analysis, so I wouldn't do it myself. 

15] Q: Have you written yourself that the 

16) appropriate measure here is the mean rather than 
r?) the median? 

m A; I have written it to the extent that 
I9l that's what I said 1 did in my report. 

MCI Q; No,] mean in the iiicraturc. in 
[111 articles that you have written. 

( 12 ) A: This is so commonly done in hundreds of 
[III publications every year, that the idea of making 
[14] the assertion that one should use the mean or 
(isj defending the assertion that one should use the 
ii«j mean could not get published because ii is so 
ii7] common knowledge in social sciences. 

(Kj Q: Could never get published? What do you 
[■gi mean by that? 

tata A: In good journals, you have to say 
rat) something new that people don't already know in 
1221 order to get published, generally speaking, and in 
^ a methods general, it's just very unlikely that a 
I24| journal would find a stacement like that to be of 
[ 2 si any value, because essentially everybody in the 


Pa9e 481 


2—16:18:52 25—16.21:36 Pago 482 

Ml Krosnick 

Pi profession recognizes that and conforms to it. 

PI MR. 8LEAKLEY: I will turn it over to 
(4| Mr. Williams. 

isi EXAMINATION BY 

fEi MR. WILLIAMS: 

(71 Q: Dr. Krosnick, my name is John Williams 
(ii and I represent RJ. Reynolds 
I9| Right before the break there was a 
[101 series of questions about the statistical 
tm signiTicancc you had found comparing various 
[121 expiosurc groups, one among the other. I just want 
[LSI to make sure that I understand precisely what your 
li4| conclusions were there. 

MSI A; I am sorry, can I just interrupt? I am 
[iq actually finding myseIf distiactcd by the walking 
[17] and talking. Is there a way we can get physically 
[isi closer to one another, so 1 can lunc that out 
|iq better? 

I MR. WILLIAMS: There «s a way to trade 
I2i| places. 

(221 Off the record just a moment. 

123J THE VIDEOGRAPHER: The time is 4 19 
1241 p.m.We arc going off the record. 

PS) (Discussion off the record.) 


Oi 

ro 

4?. 

CiJ 

-li¬ 

en 

cn 

OJ 


SPHERION DEPOSITION SERVICES 


Min-U-Script<3 


(53) Page 479 - Page 482 


http://legacy.library.ucsf.edu/tjd/Byq:O'^aO0/pdi.industrydocuments.ucsf.edu/docs/ryhlOOO1 





JON A. KROSN1CK 
March 12, 2001 


BLUE CROSS ANO BLUE SHIELD v. " 
PHILIP MORRIS 


in 

K 

PI 

HI 

1S1 

IS] 

m 

w 

pci 

P') 

['*] 

[»a| 

l«*l 

[*si 

[i«! 

■in 

••I 

VII 

231 

34) 

2S| 


PI 

P] 

m 

n 

PI 

m 


»ci 

'll 

4 

a 

5? 

a 

7} 

m 

a 

31 

a 

*1 

SI 


2—16:21:37 25—16:22:38 Page 483 

Krosniek 

THE V»DE0GRAPHER; U » 4.22 p.m and 
wc are back on the record. 

BY MR. WILLIAMS: 

Q: Or. Krosniek. a few questions on the 

significance that you found among your 
c^mparis&n exposure groups, and I wanted to stan 
group of all respondents. 

^n the group of all resptondents, when 

the control and SG group against the 
SGTv^biip, as you jusi indicated, you did find 
staji^icai^ignificancc, correct?. 

I compared the group 

ainst thcTB and SGTB group,testified today 
I found statistical sipu&^anlc? 

|hoi testify to that. 

Pdid not testify to ihai?^^^^ 

I't believe I have don^ 

^ght, so — my confusih 






^ not know if it's a 
IlyiVgnificancc compar 
of the and ! 

group 


|bet^cen, an 
"^against the 
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you done that calculatioj 
t believe I have, no. 
ivc not done the calculation? 
t remember having i 
^respect to this group^ 

:s, if you were to look 
ups separately, the^ 
significant diffcrcnci; 
y of these groups in | 
to quit? 

ER; Objection, 
not correct, 
group is statistically 

^npol group is statistically 

Lffcrtm fnsm ihe SGTB group. 
Q: In the group of all respiondenis? 

A: Yes. 

Q: Now let's fust look ar current smokers, 
not former smokers. 

A: Okay. 

Q; If you look at current smokers and look 
at the individual expiosure groups, the four 
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HI Krosniek 

(?I exjxisurc groups separately, do you get any 
111 stalisiicai significance? 

M A: 1 don’t know the answer to that 
IS| Q: Have you looked? 

|E] A: I have done an analysis that is somewhat 
f 7 ) relevant to what you arc saying, but exactly what 
( 8 J you said. 

19 ] Q: What analysis have you done? 

[ 11 ^ A: What I have done is to again combine the 

|ii| control group with the SG group and to compiace that 

nai combination with the SCTB group. 

[•a; Q: And you found no statistical 
!i<i significance? 

[IS) A: And 1 found a statistically significant 
|is! difference between those iwo. 

[in Q: You found a statistically significant 

[lej difference between the control and SG group versus 

[iBl the YB and SGTB group’ 

[3(S A; No 

[zil MR. HEFTER: Objection. 

[aai Q; No? All right. 

(aai What statistically significant 

UK) relationship did you find in the group of current 
psi smokers’ 

2—16 24:26 25—16 25:14 Page 486 

[ij Krosniek 

[Z] MR. HEFTER: John, 1,think the term is 
PI significant — 

P] MR. WILLIAMS: I am going to find out 
P) right now. 

PI MR. HEFTER: Well, it is statistically 
m significant difference and you have been 
PI asking just statistic significance. 

PI Q: Did you find any statistically 
[ 1(1 significant difference in the group of current 
[ii| smokers? 

[iJl A: Yes. 

[131 Q: In which comparison group’ 

|i4) A: I compared the combination of the 

[isi control group and the SG group only with the SGTB 

(IS) group. 

|i7l Q: And it is statistically significant to 
im what level, sir? 

[i9l MR. HEFTER; Different, 
pq Q: DLffereni lo what level? 

I?il A: Let me tell you, in case you art; 

Rii confused.This was done with a slightly different 
rwi methodology than you may be looking at hcrc.This 
p4| was done in Usrcl (phonetic), which is a 
psi structural equation modeling program,and you have 
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for monihs had the printouts of that analysis 
That IS not wrincn up in my report, but it was 
submitted to you long ago. 

Q; To what degree did you find it to be 
se^istically significantly different? 

A: All I can tell you is that the P \-aluc 
gSms less than 05. but it may have been 
considerably less than .05.1 just don't know the 
gd^ils. I did it to reassure myself and I was 
jiTOTSured. 

^J: Did you look at that with respect to the 

of just Blue Crosswu c Shie ld subscribers.’ 
you stratify your dat^^^^^tray? 
i^A: 'Well, the end of thBrepon involves 
^^knting Blue Cross-BI^Se^hj^ subscribers from 
n^subscribers. yes. 

And looking at thc%ioup^all Blue 
^a^ss-Bluc Shield ever — you have the 

vviwd 'ever" in your ronipiMfeaaAiEfam. so you know 
what I am talking abouts^^^^^ 

'Yes, 1 do. 

r^^Have you looked to detem^nc any 


K|ant di| 

0 #*ps? i 


^stically !| 
ft exposu 


IX> you mind if 1 cd 


i berween the 


Krosnifit 


may. :: 

HEFTER; We arc i^Kin^aTOul the 
^^^ivation to quit? 

WILLIAMS: All of this Ls J 
^^Mivation to quit right 
When 1 am asking 

gggjl^Stically significant di^cr^cc^you 
^^brsiand I am talking 
^^^^ivarion-lo-quii index that you created? 

Yes, 1 do. 

^^5: And in which cxpiosure groups did you 
a statistically significant diffcirncc? 

That, 1 can't answer. 1 don't remember 
^^^if^cally.What's in the repon here is a 
^l|^»^|ancc test of whether subscribers and 
nonsubscribers differ from one another in the 
impact of the manipulations, and that P value 
is .71. which means it is not even close to 
significant, but 1 can't go beyond that in 
answering the question 

Q: .So you did not compare the individual 
exposure gniups just in terms of the subset of Blue 
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[tl Krosnick 

PI Cross-Blue Shield ever subscribers? 

PI A; 1 can't say that 1 didn't — if I did, 
ia| it's in the printouts that you all received a while 
(S| ago. 1 just am not remembering what those — I 
j (G) would think those results would have been 
m associated with this test here, but I don't — I 
IGi don't remember what those results were. 

PI Q: And you recall a funher stratification 
iioi in terms of looking at Blue Cross-Blue Shield 
I HI current smokers? 


(131 Q; Do you recall whether or not you 

(Ml obtained any siaiisiicaliy significant differences 

(isi in your exposure levels in any of the Blue 

( 16 | Cross-Blue Shield only subscriber population that 

(i7| you looked at? 

[IGI MR. HEFTER: Objection. 

(lai A: No. I don't, and the reason I wasn't 

(3111 looking at those is because once you start 

P(| stratifying down to pretty smaller levels, the 

[231 samples get much smaller and statistical power goes 

P3| down substantially, so 1 don't remember conducting 

(241 and certainly don't remember looking carefully at 

(3s| any such analyses because of that. 
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PI Q: 'With respect — you did say you did an 
I PI analysis stratifying current smokers and former 
(4| smokers in the all respondents category, correct? 

I&i A: That's correct. 

(Gt Q: Did you And, sir, that former smokers 
[7] were more likely to quit than current smokers? 

(ci MR. HEFTER: Objection. 

(9) A: That isn't a question chat is answerable 
(101 with our data. 

( 11 J Q: Did you find that former smokers were 

(131 much more motivated to quit than current smokers? 

(131 A; I didn't do that analysis. 

(14) Q: Do you have any expectation as to what 
1 ISI you would find if you had done that analysis? 

[iG] A: 1 think wc have to be clear here that 1 
(i7| don’t think, taken literally, that people who have 
uo] already quit have a motivation to quit. 1 don't — 

['91 now, I did use the label 'motivation to quit" to 
[391 describe the index, but I hope I was clear that was 
Bi) simply a label for convenience. Since there are a 
|33l lot of components to it. there is no single good 
(n( label, so I used that one. but — 
ip4| Q: The label was the same, but the factors 
ItJsi that went into the determinations were different 
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for the former smokers and current smokers, 
correct? 

A: Correct. 

Q: Now let me move on — lam going to come 
to the motivation to quit in a few moments, 
b^t I wan^d to ask a few questions about your 
because I had some confusion, 
indicated to Mr. BIcakIcy that you 

'TTtpert in determining the 
Ttl^ns that people start smoking and the reasons 
,ue smoking, correat 
expertise in those arc£ 
rt somehow and 1 
cs. 

Idn’t have any probl^i 
ns about whether yoi 
tp use the same deflnic 
. I mean, I did have a 
trouble at that time. I often do 
exp^L is used as — 

~ "' n he continued to 
ith him. ri] 
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1 acceptable 




m your 


a—' 



opinii 



•5—16 

Krosi 

ictors of smoking oi 
ER: Objection, 
a complicated ans' 

socia^^t^ciors and there are cp{jaJ,ve 

b my knowledge, from the liWraiure 
•xpertisc in, there is ^a^^ ^that 
a role in dctcmunit» whether a child 
li^ke or not. 

about sociaLreJdiciprs 



I thiough the list of socia l 
irs and then we will get to cognitive 

I 

^is also evidence that peers play a 

y^ning whether a child starts to smoke 
: is also evidence siblings play a 
lolc in determining whether a child scans to smoke 
or not.Thcre is also evidence that authority 
I figures such as teachers can play a role as welt in 
I influencing that process. 

I Q: May 1 stop you for just one minute? 

I A; Sure. 

I Q; When you were saying predictors, I am 
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[7! talking about predictors towards the .smoking 
PI decision, so you can have negative predictors and 
|s| affirmative predictors, right? 

15 | A; Absolutely. 

IE] Q:; 1 am asking about affirmative predictors 
P) now,Arc you say that teachers, what teachers' 

IS] views are is an affirmative predictor of smoking 
(91 behavior? 

rro] A: We don't really think in our literature 
in) about a distinction between affirmative predictors 
(IT) and the opposite. What we think about is the idea 
[13] that in this case, when we are talking about social 
im predictors, is that the behavior of each of these 
(IS) categories of people can influence whether a child 
li«) starts to smoke or not. So, in other words, we can 
[17] talk about teachers, for example, as modeling 
(i>i cigarette smoking for children, as doing nothing, 
ii«i and saying nothing about smoking, or as making 
170 ] statements that are antismoking. and so if teachers 
| 2 i| model smoking for children, that enhances the 
(zq likelihood that they will start to smoke. If 
(23) teachers make statements suggesting kids not smoke, 
(74) that will reduce the likelihood.'You can’t really 
ITS) categorize a person as affirmative or discouraging. 
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f'l 

!7i O: 1 take your point. 

^ (3) Can you continue with your list of 
|4) social predictors’ 

(« A: There is also liictature on the impact 
ici of mass media advertising on children's initiation 
PI of smoking. 1 know that literature to be 
!■] controversial.! have not spent time carefully 
(■I reading it, reaching a decision about it.That 
(lo) puts it in contrast to the other categories of 
111 ) social predictors 1 have mentioned. 

I17) Q-. Are you going to eitpress an opinion in 

(13) any way on the impact of mass media or advenising 

114) on the smoking decision? 

A; I have no plans to. 

Q; Go on. Anything else with respect to 
social predictors? 

A; ] don't think so. 

Q: Cognitive predictors? 

A: All right. Now, in the cognitive 
pii predictors domain, really, this includes a scries 
27) of beliefs that you might say reside in the head of 
I73i a child or an adult about the effects of smoking in 
(74) a vancty of ways. So, for escamplc, a child might 
(75| believe that smoking cigarettes might make him or 


I'il 

l'«) 

I'U 

[ 1*1 

(19! 

120 ) 
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her more popular. A child tnighi believe ihat 
!ifiviktng would make him or her more relaxed in 
social situations. 

Q: May 1 stop you for a moment? 

I i^derstand lhat these arc all 
th^rics. 1 am interested in what your opinion is 
I expert. I understand there is a huge anx>unt 
"of litetatute out there on all of these things. I 
asking, in your expert opinion, what arc the 
titive predictors of smoking onset. 

That’s what lam describing fur you. 

' you are giving of the things 
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I you believe are cognit 
Yes, I am. 

: So you said pxapula 
?Bcitcfs about popul|r^ 
efs about relaxation 
efs about the health q 

II guess what I will d<| 
category which doesn't 

ediciors which might 
^ors, and this mighfnv 
ncthing tlu^^^cn ca 
Ihcr ralle^. r4s kitaking 


idictors? 




sequences, 
comfon, 
nccs of smoking, 
:atc a new 
ndcr cognitive 
personality 
, for example, 
liousncss. 
enufion. 
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, Sir. 

between 

behaviors? 



Are you aware of t: 
suggests there is a tela 
ing onset and other 
IH. HEFTER: Objeciiol 
Yes. 

: You are aware of that litc ramFc? 

; Yes. I am. 

i Who would you cito as yme of ihe 
orities who have wr^m^^^ffiat area? 

Well, it's a very larg ^atayi^ . but 
ise Kandcl is a key person whose work who has 
present in that atra. 

Could you spell that for the reponer? 

Sure. Kandcl, K-a-n-d-c-l. 

Guy E*arcel, P-a-r-c-e-l. you don’t know 


am sorry, I misunderstood Say lhat 

ji»i again? 

t 2 <l Q: Guy Parcel — 

p>l A; Guy Parcel, no, I don’t know 

jzn particularly. 

1231 Q: .lessor? 

P4| A: Yes. Dick Jessor. sure, 

psi Q; Anyone else’ 
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PI A: There arc lots of people,This is a 

|3| very large literature. 

PI Q; Risk-taking behavior, you mentioned. 

IS] Let's go on. 

|G 1 You started talking about personality 
PI predictors and you had rebelliousness and 
fsi nsk-taking behavior — excuse me, risk-taking 
PI orientation 

l>oi A; Those are the variables that I focused 
[t>i my attention on. so 1 will stop our list there. 

|i7i Q: AH right. 

l!3l Now, you stated that knowledge of health 
|i«j consequences is a predictor of smoking onset, 
|is) correct? 

IIS] A: Yes. 

|17) Q; 1 want to ask you a similar series of 
(IS) questions with respect to predictors of smoking 
(191 continuation, or if you want to state that in 
!») converse, the predictors of quieting behavior 
1211 Would your list be the same or would the 

[221 list be any different? 

I23| A: The lilctaturc on quitting has taken a 
12*1 different form typically. It's been primarily 
I 2 si among adults, it’s got a large focus on the impact 
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(21 of intervention efforts, nicotine patches and 
PI devices to hicilitate the process and so on, so I 
PI definitely would not give you the same list because 
(S) the issues that have been focused on in that 
[SI literature are different, but — 

[7] Q: I am just asking for your expen 
1*1 opinion. 1 am aware that there is an abundance of 
191 liieiature on all aspects of smoking.What I want 
(loi to know is your expert opinion as to the ptedictors 
|iii of snnoking continuation. 

A: Okay. I started to answer that, I 
|i3i think, by saying that the literature has identified 
( 1*1 many different sons of predictors that would not 
[>si come up in this list, so I was answering your 
MS] question about would I give you the same list. 

Those predictors include beliefs about 
[HI ihc health consequences of smoking. 

1 ’^ Q: .lust to shorten this, you already gave 

( 20 ] me that when I asked you the questions about 

| 2 <l smoking onset. 1 am asking you is the list the 

(221 same as the — you don't need to repeat the ones — 

(231 A: 1 am sorry, I have said the list was not 

( 2*1 the same, and I guess 1 was going beyond that to 

f?si clarify what would be on the list. 
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It) Krosnick 

P) Q; AU righi, do it that way What would 

pq be on that list? 

m A: As I said, health consequences. 

(S) Q: Hcahh consequences,! got that, 
m The nature, quality of intervention 
[75 p^gratn^hat individuals participate in, wotk has 
m sn^^^^errnt sorts of intervention programs 
iM d^fer tn effectiveness. 

1 stop you there? 

Sufei 

^ Ar^ou saying that intervention 

5 onset of 
, but you 


rare not a factor in le 
Ibu didn't mention th 
I in icrrhs of cessation. 

f am speaking of inte 
programs^esigned to facilitate 




tier qui 


hey would not be, 
ybe 1 misundcrsi' 
ion. If would you I 


21 ) intervention programs been do 
^t, absolutely there 
eciivc. so — 





;5—I6.i 
ffrosnli 
ivcncss. Studies witH 
ISCt? 

it’s dozens of sludies| 
very large sci.Thc sthdy I woHted 
■ University was effective, iliirrc were 


u give me the name i 
think it had a name. 

uld 1 find out abou^ 

ER: You have the pu6 


vitae. 

n your vitae? 

ii recall the name? 

po name.There are two 
it came from that study which 1 

a discussed extensively at my first deposition 

4 Q: Co ahead. What are the other 

■I imervcniion studies? 

ii A; There are groups at the University of 

i| Minncsota.at the University of Southern 

i| California, at the University ofTcxas, at Stanford 

4 University, all of which have mounted successful 
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I7i intervention studies. 

I3| You know, it's a very large literature. 

HI There are review aniclcs. for example, in the 
[5I American Journal of Public Health reviewing the 
[Bi impact of these studies. 

[7] Q: i assume all of those arc published? 
i>i A; The ones 1 am referring to arc 
w published, yes. 

( 10 ! Q: They arc on your reliance list? 

i(itj A: No, 

jn?; Q: Let's go ahead with your list of 

1(131 predictors of smoking cessation, or continuation, 

jiiij A: Those arc the predictors that 1 have 

jiis) focused my ancniion on 1 an tell you have played a 

(IS) role. 1 know there arc others. 1 am just not in a 

(IT) position to detail them for you. 

[lai Q; Let me ask you this question; Arc 

(iBi parents a predictor of smoking continuation? 

(SOI A; 1 don’t know the answer to that, 
pi) Q: Are peers a predictor of smoking 
PS) comimiaiion? 

fni A: See, I am having trouble with the 

p*) question, because, in other words, we typically 

psi wouldn’t do our analyses — I thirik, if 1 am __ 
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PI understanding the question, you arc saying, okay. 

P( let's only focus on people who have started to 
H) smoke, and the question is. can we predict which of 
(sj those people will quit and which ones will not. 

!«S Q: No. Let’s start again. 

P) You indicated right off the bat that you 
m considered yourself an expert in determining the 
isi reasons that people start smoking and the reasons 
(ID) they continue smoking. 

( 11 ) A; Just to be clear, what I said is I have 
(izi expertise.That expertise docs not claim to have 
I’S) all of the deuils of that literature. It claims 
tui to have some deuils, and I have told you about 
[isi what 1 kmw in this area. 

[ 1 C! O: And you gave me a list Of all of those 

117 ) factors that in your expert opinion were predictors 

|ia) of smoking ortsci, correct? 

(IS) A; That I am aware of. yes. 

po) Q: That you are aware of. Well, if you are 

pi| not aware of something, you can't be an expert in, 

1221 it okay’ 

P3I A: Okay. 

p«i Q: And then I asked for a list of those 

ps) predictors of smoking continuation. 
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A.; And I am having trouble with the term 
"continuation" and 1 tried to define it and I think 
you were suggesting I didn't define it the way you 
meant it to be defined. 

Q; What arc the prediaors. what factors in 
Ih^tcniturc, in your expert opinion, will 

lict whether somebody will continue to smoke 
ice they have started to smoke’ 
t. HEFTER; Objection. 

Can you answer the question? 

I tried to interpret the question a 
lent ago by saying 1 c^^jenvision an analysis 
ighi be done where^^^^uscs only on pieople 
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arc smoking and the! 
that predict whet 
are^e people who quit ^ 
Is that a correct int< 
That's fine. Co ahea 

y- 

A; The list 1 gave you a 
dictors that 1 feel c‘onl| 
reviewing additii 
^mented bee: 

$ciors of luijujlig be 






t what arc the 
atTlimg that group, who 
fio|arc those who 


iwer It in 

the 

ing here now, 
ments, arc 
;o be reliable 
therefore, I 



5:35 


, the way you arc usij 
Inuation, because cond" 

T image of quitting 
? And that list includej 
ams and health cons^iiqoenscs? 
That’s correct. 



predictors of 
is sort of a 



■|ii| 

cn 

li: 

l'*l 

|isi' 

liq 

firi; 

l'») 

1191 

pq 

p»i 

PJI 

P31 

IM| 

PS| 



ent opinion 

rt there, 
port there? 


else? 

I Not that I can offer: 
t today. 

Do you have your eij 
ffsc? Do you have youri'expett i 

^Yes, I do. 

By the way, before 1 forget, I want to 
ut a proposition to you and just ask on this, 

we are on this topic, whether you agree or 
c. and the proposition is this, 
ning? 

A: Yes, I am. 

Q: Knowledge of long-term health 
consequences of smoking has not been a strong 
predictor of adolescent smoking. 

'Would you agree or disagree with that 
propxjsiiion? 

MR. HEFTER: Objection. 
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m A; Say that one more time, please 

Uj Q: I will say it again. 

I<j Knowledge of long-term health 
IS) consequences of smoking has not been a strong 
IE) predictor of adolescent smoking. 
m MR. HEFTER; Same objection, 

IE) A: There arc a rtumber of pieces that I have 
P) trouble with. One is "has not been," referring to 
ii3) the past tense. 1 am not clear about what period 
liil we are speaking about. 

Ii 2 ) Q: 1990s. In the 1990s, would it be 
|tj] accurate to say that knowledge of long-term health 
[u) consequences of smoking has not been a strong 
[ 15 ] predictor of adoicsccni smoking? 

|t6) MR. HEFTER: Objection. 

)!/) A: Most of the data I know about on this 
)i») issue were not collected in the 19905, so I can't, 

)i9i with confidence, agree or disagree with that 

i?o) siatemcm about the 1990s. 

pi] Q; As of 1993. would the following 

P 2 ) statement be something you could agree with or 

P3) disagree with, and 1 am going to say it for a 

p<] fourth time. 

ps] Knowledge of long-term health 
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PI consequences of smoking has not been a strong 
PI predictor of adolescent smoking. 

|4| MR. HEFTER: Objection. 

[s] A: And 1 asked "has not been" referring to 
)6] what time period and you said the 1990s. Did you 
17) mean earlier? 

[Bi Q: I am sorry, prior to 1993 or 1994, okay, 

(D) as of that date, would you agree or disagree with 
|iq that? 

A: Prior to that, okay. 

I would neither agree or disagree for 
(13) the foUowing reason, that my understanding of the 
(i4| literature is that it has quite consistently been a 
risi reliable predictor of smoking behavior. 

[lEj 0: What has? 

|t7 ] A; The question, then is is it a strong 
ii«) predictor or is it not a strong predictor, and we 
H9) don't have universally agreed upon or largely 
po| agreed upon sundards for what a strong predictor 
pi) or what a not-strong predictor is, and therefore, 
p?i it is not easy for me to agree or disagree with the 
P3| strong pan of it. but I would agree with a 
pt] statement that says it has been a consistent 
ps) predictor. 
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IM Krosniek 

17] Q-. So you believe that as of 1993 ot 1994, 

ra knowledge of long-term health consequences has been 
K) a consistent predictor of adolescent smoking? 

I5i A: And by consistent, what 1 mean is across 
m many studies conducted over decades, yes. 

[7] Wabout this statement: As of 199 J 
m ofeJ.994-j^ftuatlv all U.S. adolescents, smokers 
n ano^OTlsmokcrs alike, arc aware of the long term 
I>D| h^^he^cts of smoking. 

(M) i^^^^birings us ta^k to a discussion we 

Ii 2 | h^cariicf about the distinction between aware and 

|i:8 will permit me the 

lit] for aware, that that 

[isi Slaking «uses undesirable he^mTconsequences. I 

l*«l a^^^a^hai statement. 

|i7| Q: Do have your rcpon. 

I’®* ^1 i^^ty go to that now. sir. 

120 ) If paragraph 60. do 

ail that there? 

aai A: ^fc^I do. hsssssss/f!^. 

731 Q: talk about there tnes^^^rd 



PI rescan 
m rebthi 

M Ai^ 

"* 

111 attemi 
111 A: N 


ec that there? 

ER; In paiagnph 60,Jim?^ 
lAWS: Yes. 


state that in your SSRST^ 
iat you anempted to 

^cuse me, no. 

gu not in your SRBI rcl«i^ 
measure something 


live risk? 


la Q; TOffOTdo't? What did you do? 

■4| A: V^^mempted to measure perceptions of 
isi rclatii^^^^ 

>q Q: the nexi few paragraphs here, you 

7| talk ahp^^^w you went about or SRBI went about 
•I mcasu«t a^paa4 eptions of relative risk, correct? 
d A: Yes. 

'VI Q: Now, paragraph 68. could you focus on 
■ii that. 

■ 2 ] A: Yes. 

■31 Q: You say. in order to gauge people’s 
4| perception of the increase in the risk of lung 
^ cancer caused by smoking, perceptions of relative 
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p) risk were calculated, and then you go on to explain 
PI why. 

|4| Do you sec that? 

|S) A; Yes,Ido. 

j6l Q; And then you go on in paragraph 72, if 
PI you keep going, to conclude that the vast majority 
(4j of American snxikers underestimafc the increase in 
P) risk of gening lung cancer, right? 

[lOi A: Just to be clear, that is current and 
( 11 ) former smokers. 

tiz] Q; Current and former smokers, yes. And 
(131 that’s going to be your opinion in this case? 
ti4j A; That's correct. 

[i5| Q: That the vast majority of American 

[161 current and former smokers cuirentty underestimate 

|i7| the increase in risk? 

|i«t A: That’s correct. 

(i«) Q; Now here's my question: Is there any 
120 ] difference in your mind between the concept of 
pi| perceived relative risk anributable to striking and 
(221 the concept that you express in paragraph 42 here 
(zft of increased risk attributable to smoking? 
p4| A: You didn’t mean paragraph 42, did you? 

( 2 S) Q: Paragraph 72. 
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P) A; 72, okay, that's a new one? I am sorry, 

PI just give me a second to read 72.1 don't think we 
14| got there yet. 

(SI MR. HEFTER: Can 1 have the question 
16 ] read back, please? 

PI Q: No. we did get there.You just 

p] corrected me when 1 said American smokers, you said 

p] American current and former smokers. 

( 1(11 A: Sorry. You arc right. 

( 11 ) MR. HEFTER: 1 am confused because you 
|171 said paragraph 42 and I would like the 

(13) question — 

(14] Q: Paragraph 72 is in front of you as 
( 1 S 1 well. 

(iq MR. HEFTER: 1 know, but 1 want the 
(171 question read back. 

( 1*1 MR. WILLIAMS: Let me restate it. May 
Itsn I restate it? 

(201 A: I'll tell you what, can I read this 
pij first and then you restate it? 

1221 Q: Yes 

(231 A: Thank you 

p<) Go ahead 

psl Q: Now, my question is this: Is there any 
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Krasnick 

difference in your mind between the concept of 
perceived relative risk attributable to smoking and 
the concept expressed in paragraph 72 of increased 
risk attribuublc to smoking? 

I was using the phrase increased risk to 
be Synonymous with relative risk- 

: So in your report, if we see perceived 
relative risk or increased risk, we can use those 
inte rcha ngcably? 

Yes, please. 

T Is it your opinion, sir, that there is a 
tionship between an^Vtdiyidu^l s perception of 
itfve risk and smokin; 

X: Yes. 

Is it your opinion i^fjndT 
'cive the relative risi 
c likely lo sun smoksng 
cive the relative risk^ 

Yes. 

Q: Let me ask you thi:^ 
rates, because you 
f^io, correct? 

: In vou^^ ^^ on, do j 



luals who 
^ing as low, arc 
lihosc who 


^cse relative 
plated a relative 


Eviduals who have 



54:21 Sa5«tfetfefe 32 

ffWnsnfcJf 

th&same relative risk tat^lji^^^c same 
reeptions of the incrca^d^^^of smoking? 

: Not necessarily. 

: How would they b^KEflffSiit? 

: Two people, for cx^hfpKf’^lapuld differ in 
cenainty with whici^they hggd — 

: Take out ccruinty. PnvR^man 
inty. 1 understand 

Okay, sorry, then ycJu^ltcriStatc the 
ion again. 

All right. Holding consunt the concept 
ruinty — holding constant the concept of 
hainiy, docs someone who has — 

R. WILLIAMS; Let me strike that and 

fc on. 

1 ,1 will ask the question, 
olding constant the concept of 
certainty of belief — 

A: Yes. 

Q: — cJo individuals ^ho have the same 
relative risk ratio have the same perception of the 
increased risk of smoking^ 

MR. HEFT€R: Objection 

A: They do in terms of the ratio, but they 
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don’t necessarily in icrms of the ingredients of 

the ratio. 

Q: And by ingredients, what do you mean’ 

A: Well, the two numbers that were used to 
calculate relative risk, 

Q: Oh, sure, right The ratio would be 
different, but they would have the same relative 
risk? Is that your view? 

MR. HEFTER; Objection. 

A: Not exactly. What 1 was saying is the 
ratio could be the same for two people,but the 
ingredients could be different. In other words. I 
could think two nonsmokers and four smokers, you 
could think four nonsmokers and eight smokers We 
would each have the same relative risk ratio 
whereas the two ingredient beliefs used to 
calculate that ratio would be different. 

Q; Let me illustiatc this. 

Go ahead, I did not want to cut you off. 

A: 1 just wanted to be clear. If we are 
calking about people’s actual perceptions, then the 
way you phrased it is correct, but just to be 
clear, in ease you are moving toward this — in 
every survey measurement, particularly a 
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measurement like this is going to have some small 
ariKium of random measurement in it, so when we 
measure two people to have a relative risk of five, 
it's not necessarily the case that those two 
people, in fact, haVc identical relative risk 
percepiions.Thcy could be slightly different from 
one another, but they appear to be identical in 
this measurement. 

Q; And those people would have the same 
perception of increased risk as well, because we 
can use those interchangeably, correct? 

A: Yes. According to this measurement, 
right 

Q: Now. we have primed out from your 
database some numbers. Of alt of the respondents, 
who, according to your ratios, have a relative risk 
of 2.0, in other words, they believe that twice as 
many smokers will get lung cancer as nonsmokers, 
okay? 

A: Yes 

Q: And 1 am going to give this to your 
counsel. 1 know you probably haven't seen 
something formatted like this before, but I will 
represent that this is a direct printout from your 
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cn 

cn data. 

(3! MR. WILLIAMS: Do wc have an exhibit 
14) number yet from today? 
isj MR. HEFTEH: This is number one. 
tBi -pmi. WILLIAMS: How about that, at 5 

.clock itjthe afternoon, we have Exhibit 1. 

NESS: Only because 1 don't have 
tel tonight, it might help lo get a 
.“'“'f how long — 

yiR. HeN'ER: Perhaps we should discuss 


UAMS: Do you want it 

ER: Let’s go off for 

DGRAPHER. The ti\ 
are going off the re 
skm off the record.) 
THE VIDEOGRAPHER; The ti 
2)1 and ^ arc back on the rccottl.| 
22 ) Exhibit l.twopai 

23| hca<^.,*Re^ondcnjt^jBSijO havi 
t relative 2.0,' 
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n, as of 



itc.) 
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t to focus here on r 
,Kra$nick. 

FSaifea^ll. there is a group 
ri^t^ th!^ middle here, in whi^ 
m risk i 
[Tj 10 ni 
n okay? 
w ^ 

01 @ 

I) the 
21 nui 
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cUtivc 

nd that is because they belike that 
[kers and 20 smokers cancer, 


*1 

1 

ft 


■i inci 


ten there is a group c 
, also relative risk of i 
50 and lOO respectively 
:c that? 
fts.Ido. 

^H^iavc a relative risk of Two, right? 


first group estimates that the 
will be 10 out of a thousand 



■I smokers, correct? 
oi A: Yes. 

ii Q: The second group believes the increase 
2 ] will be 50 out of a thousand smokers, correct? 
31 

«l 


A: Yes. 

Q: Now, those people have the same 


s] estimates of relative risk, in your view, correct? 
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PI A; Yes 

PI Q: Do they have the same view about 
|4| increased risk? 
isi A; Yes 

ici Q; Now, which group, in your view, is 
(71 likely to Stan — is rnore likely to stan to 
i«i smoke, the group that estimates an additional 10 in 
w a thousand, the group that estimates an additional 
[) 0 ! 50 in a thousand, or is it the same? 

(Ill A; It's the same. 

[ 12 ( Q: Let’s go to the third group, if you 

ti3| could turn the page to, actually, the end of the 

i|i4) page.There is a big group of 33 people who — 

|(isi some of whom — excuse me. all of whom think that 
i(isi the number of nonsmokers is 250 and the number of 
l)7] smokers is 500. Do you sec that? 
ii«) A: Yes. 

ii»i Q: Still a relative risk of two? 

(201 A: Uh-huh. 

pi| Q; And these people have exactly the same 
( 22 ] perceptions of inercased risk as the first group, 

(231 in your view, correct? 

(241 A:. Yes. 

ITS] Q; This group thinks that 250 more people __ 

2—17:00:55 25—17:01:39 PagB SIS 
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( 2 ] are going to get lung cancer than the first group 
(31 that thinks just 10 pieoplc are going to get lung 
|4| cancer, 10 more people arc going to get lung 
(SI cancer, right? 
tm A; Yes. 

(7) Q: And in your view, they have the same 
[ft perceptions of ri^, correct? 

01 A; No. 

()□{ Q; Relative risk? 

( 11 ) A: Yes. 

(121 G: Increased risk? 

[131 A; Yes. 

|i4] Q: Now let's go to the final group on this 

|)S1 page. 

I<E] By the way, all of these people 

( 1 ft undcrestimarc the risk, in your view, the relative 

1)41 risk, in your view, correct? 

(131 A; Correct. 

I 20 i Q: Can we go to the last group — there is 
( 2)1 a group of 17 right at the uil end. If you will, 

I27| just take a look at that for a minute. 

(23| Those people estimate the risk of 

124| getting lung cancer, if you arc a nonsmokcr.at 

[761 500. and the risk of getting lung cancer, if you 
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arc a smoker, ac ) ,000 oui of I .fXX), right’ 

A: Yes 

Q: So they are virtualty certain — not 
virtually certain, they arc certain that somebody 
wkm smokes is going to get lung cancer? 
HEFTER: Objection. 

No. 

Q: They believe 1.000 out of 1,000 arc 
ig to get lung cancer? 

Yes. 

They believe that if you smoke, you will 
.ung cancer? 

IR. HEFTER: Objectioji 
A*; No. 

^Thcy don't believe ^t? 

/^Ybu said certain, ani 
— as we talked abo 
^^■niy.but this is their 
Their perception is 
you will get lung cancer? 

IR, HEFTER: Objectioj 
ot if they arc not 
We doi^^fiSjshv if I 
in here 
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— they 

they may vary in 
n. 

u smoke. 


reent certain, 
percent 


S:20 

Krosniek 

< 

My data will allow at 

ainty.and there is distrmbti^of certainty 
dialed with these ansa^^^^ it is very rarely 
timally certain. 

Can we at least agie^lTTlSt'but of this 
jjp they believe that 1Q0 pcrct^t of smokers will 
ang cancer? 

K Yes 

And the relative risk' is 
That's correct 

And in your view, th?y"undc?e5timaie the 
i^ve risk? 

Right. In my view, all of these groups 
|civc their personal probability of gening lung 
"aK% er implicated by smoking to be double whar it 
jid be if they hadn't smoked. 

I is it your opinion, sir, that even 
(IS) though this last group can all believe that it is 
i»i 100 percent chance of getting lung cancer, that 
i:i| they still underestimate the ri.sk? 

I? 2 | A: The relative risk, 
jrsi Q: They underestimate the relative risk, 
even though they believe a thousand out of a 
I 2 S| thousand ate going to get lung cancer’ 


Page 520 



2—17:03:22 25—17 06:23 Page 521 

I If Krosnick 

PI A: Yes. 

PI Q: I want lo give you another example, sir, 

[‘‘I and ask your opinion as to predicting smoking 
|S| onset, and it is this;We will stay with this 
[4| group of 300 nonsmokers and 1,000 smokers, all 
n right, but wc will compare that to a group of 
(at people — and it is not reflected on here — and 
PI one person — excuse me. they believe one nonsmoker 
lia| will get lung cancer and three smokers, okay, so a 
n II relative risk of 3. but an increase of two people. 

|iji A: Yes. 

1131 Q: Can you stay with that one? 

fiaj A; Yes. 

|i.si Q; Now, in this hypothetical, you would 

|i«i believe that it is more likely for the people in 
[I n the group of 500 and I ,OlX> to take up smoking than 
(IB) the group that had a relative risk of 3? 

|isi MR. HEFTER: Objection, 
poi A: Not necessarily. 

pi] Q: Let 's review the bidding. Did you not 
p?) testify — you testified before, did you not, that 
t23i the higher a picrccivcd relative risk, in your view, 

[241 the less likely that person was to smoke? 

[25) A; Correct. 


2—17:06:24 25—17:07.33 Page 522 

HI Krosnick 

I2| Q: Now, a relative risk of 3 is a higher 
PI relative risk than 2, correct? 
m A: Correct. 

[51 Q: So you would expect that the people in 
[SI the relative risk lafio g(oup of 3 would have — 
m would be more likely to stair to smoke than the 
m relative risk group of 2, coiVcci? 

OT A: That's where wc arc gening a linlc 
(101 tripped up. Not exactly. With regard only to 
MII relative risk, yes. but there — obviously, there 
li 2 l is a second consideration here, which is absolute 
|iJ 1 risk, and that — and what you have done — up 
|i4i until this point, I ticlicvc you have mostly asked 
I'S) me questions about the impacts of these two 
[lei ingredients on relative risk, and I have agreed 
III] with all of your illustrations of the fact that 
[IS] very different absolute risk levels can be 
Ii9i associated with comparable relative risk levels, 

I 20 | just as 1 said in my original answer a while ago. 

P'l but now you have made the additional leap of going 
| 22 | to likelihood of quitting or likelihood of 
[231 starting, and when wc now move to behavior, 1 do 
P4l believe that it is potent iai — there is potential 
B51 for relative risk and absolute risk and lots of 
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|,] Krosnick 

p) Other considerations that factor in here as we have 

m latkcd about, and so, in other words, the group of 
|4| people who are I and 3. who have a relative risk of 
[s) 5, have a higher relative risk of the people who 
m ^500«nd 1.000 
f7) I Thosetwo groups also differ in the 
n levels they perceive. In other 

n i^Mds, the 1 to 3 people think the chances either 
Itq wsgg^BK^rv small.The 300 to 1.000 group 
|iij f^^civesthe chances io be pretty high, and 
|ij! e^^tn^ high in one ease, an<|iherc's plenty of 
o^ical evidence that wliehr^ guj iave a very, 
a, in this cai^P^m^ 
outcome being associated^ith * 
ad also being associiped^vitR not 
|g that behavior versu^g^^^j^ 3. that 
le differences in how'peoplelisc those 
Information, 
r am not actually in a 
?ii posa^n to tell you.sitting hcrer 
zz] tho fe^SlUa iNgroups would be 
sal thcreu soirc evidence that pci 
z»l on they s^^^Sn, my 

tSj high^S^nitcly 
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ich of 
because 
ics focus 
hances arc 
Idn'i do 


a good 
:s past the 


?2S—1 

Kros bick 

^for example, birth d 
fhat when the mother's a. 

^he probability of b 
>y many fold. It is stiiyucetm tiny, 
r. but it increases by many fi^ and 
: very focused on tha ^a^^ff d ratio. 
pother hand, when yt^iMvc got 
levels, you have to sw^^|>s case 
: of what the pcrccptjpnslof i^c 500 to 
jn people’s bchavior^^PIW^er 
imagine people will say, 1 am almost 
; to get lung cancer regardless of 
^'cf I snwke or t don't. So that ingirdicni 
ly chances arc double if I smoke — 

1 500 to 1.000 people — buv. my chances 
I regardless. 

: an additional consideration, 
iq and 1 don’t have an opinion, I have not done any 
>q studies of how absolute levels and relative risk 
!i| levels combine in influencing. I can just tell 
ai you, holding all else constant, a higher relative 
ni risk would be associated with lower likelihood of 
N| initiating but you arc holding all else constant 
■SI Q; Right. Something else you have to look 
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at in addition to relative risk is absolute risk. 

COtTCCI? 

A: Yes Well, 1 don't know that you have 
to, but it would be helpful, 1 think, to do so in 
trying to predict smoking onset and cessation. 

Q: In predicting smoking onset and 
cessation, in your view, you have to look at 
relative risk, correct? 

A- I didn’t said have to. It would be 
helpful to. 

Q: 'Would it also be helpful, as you have 
indicated, I think, to look at absolute risk? 

A: Yes 

Q: You can't look at either hictor in a 
vacuum, can you? 

A; Yes, you can. 

Q; Would it be appropriate to do so in 
trying to predict smoking onset or cessation? 

A 1 think it's a reasonable thing to do. 
sure. 

Q; Have you looked at absolute risks? 

A:: i have data with regard to perceptions 
of absolute risks. 

Q Have you done any analysis in your work 

2—1710:57 25—17:12:54 Pag® 526 

Krosnick 

in this ease as to absolute risk and its effect 
upon the smoking decision? 

MR. HEFTER: Objection. 

A; Only to the extent that we measured 
people's perceptions of absolute risks and those 
perceptions are ingredients of relative risk. So, 
for example, absolute risks arc recorded — excuse 
me. pcrftptions of relative risks arc recorded in a 
table in my report. 

Q: You State, 1 believe. Dr, Krosnick, in 
paragraph — do you have your report there? 

A: Yes, 1 do 

Q: Could you turn to paragraph 43. 

Arc you there? 

A: Yes, 

Q: You say. for a person to be accurate in 
understanding health risks, that person must 
believe that smoking definitely increases the 
chance of contracting some specific disease such as 
hcan disease, lung cancer, emphysema; correct? 

A: Yes. 

Q; Secondly, must accurately recognize the 
extent to which a person's chances of contracting 
these diseases is increased by smoking; correct? 
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Krosnick 

A: Yes 

Q: And third, you must hold these beliefs 
with extremely high confidence. 

A: Yes. 

That is your criteria for determining 
whether somebody has an accurate understanding of 
^# hcalth risks, right? 

A: Yes. 

: And i want to focus on item 2. 

Okay. 

; To accurately understand the health 
's, the person must at^bt^telyrecognize the 
m to which his chariMg^^^ntracting these 

diseases are increased; eweet? 

Yes. 

Now, arc you savin^^^gff'plf must 
w how harmful stnolf^w^^ordcr to accurately 
rstand the health ris 
1: Yes. 

Q: But you also said, I iftrThKriYf^rcsponse 

r. Dleakley's gurstio ^^ te^g^ don't know how 
uC^information somel^d«mi^t have to make an 
rmed chgiaigl^ut 
That's I 
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ipn on that? 



13:50 

R, HEFTER; Objectii 
; You are not giving an 
Thai’s correct 

: but you do know, be 

lately informed, youlfttBSTtih^dcrstand — you 
:[ have an accurate u aderstaijj ing of the extent 
hich the Chances an^ ^^^^ d? 

per ^^^^^^ ecs, it 

Now, using your definition contained in 
graph 4.1 there as to what it lakes to have an 
urate understanding of health risks, can you 

te what percentage of the people in your 
Ics chat you looked at. the sub.scriber 
iews, have an accurate understanding of 


MR. HEFTER: Just so we arc clear, when 
you say subscriber interviews — 

MR. WILLIAMS: Depositions 
MR. HEFTER; You arc talking now about 
the depositions? You arc not talking about 
the SRBl survey now? I just wanted to make 
that clear. 


I’l 

121 MR. WILLIAMS: 1 will get to that. I 
PI am not sure he has the data for that, but I 
M) will get to that. 

151 MR. HEFTER: I want just want to make 
|G| clear that Professor Krosnick knows what you 
r?! arc asking about. 

r«i Q: Let's do three questions, just to make 
m sure. 

[101 In the population as a whole, using your 
111 ) criteria of what it takes to have an accurate 
1171 understanding of health risks, do you have any idea 
ti3) what percentage in the population as a whole has an 
|i4i accurate understanding of health risks? 
list MR. HEFTER: Objection. 

1141 Arc you talking about the United 
|i7) States population? 

118 ! MR. WILLIAMS, Yes Wc will get to 
|iBI the international population with 
1201 Dr. Harris. 

I 2 tj MR. HEFTER: t am sure you will. 

I (221 A: 1 can tell you that only about 92 
123) percent of American adults currently believe that 
|r24| smoking increases a person’s chances of contracting 
_jps; some specific disease, so that's the first one 

Page 526 i 2—17:15:58 25—17:17:30 Page 530 

• ( 1 ) Krosnick 

[21 there. Excuse me, this is ail with regard to lung 
Pi cancer, so let me restate this in terms of lung 
i*i cancer only. 

15) About 92 percent of all American adults 
[c; currently believe that smoking increases a person's 
[7] chances of contracting lung cancer. Not all of 
r>i those individuals hold that belief with maximum 
tsi certainty, so right there, you know, we arc 
{101 probably down — wc have not met conditions 1 and 3 
111 ) for, I would say,about 73 to 80 percent of 

I 

l|i 2 | Americans. 

i , . 

jli3i Now, among the remaining group, when you 

|li*) say among those people who arc maximally certain 
{IS) and who do believe that smoking increases, what are 
jli«i their perceptions of relative risk, then that would 
I (IT) bring us to table 6, wc would want to see the 
'ii«i distribution of table 6, relative risks for those 
[19) individuals, and furthermore, wc would have to make 
1211 ) a decision about a range of acceptability around a 

pi| true number so, let's say that the true number is 

122 ) 13. that that is actually the relative risk of lung 

123) cancer due to this dose of smoking herc.Wc would 

124) want to give people some credit if their number 
[7S1 wasn ’t exactly 1 3, like if they said 13.Sorl2.5, 
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fi) Kro^nick 

PI maybe we would give them some credit there, and so 
(3i therefore, if we esubiish a range around 13 for 
HI that subgroup of people, we would reach some 
cw conclusion about what percentage of them meet this 
id c^eriofti^umber 2.1 have not done that analysis, 
now what it is, but ii will be 
Jy less than 25 percent of the American 

J it safe to say. Or. Krosnick, that 
pinion, the vast maponiy of Americans do 
not^havc an accurate undersunding of the health 
5u have defined that? ^ 


^ng of the health nsl^HIo ni 
Dice about smokinj’ 



; Q; Does one need to have an^ccurate 

|e an 

^cn I use the 

jtatc undersanding,naming your 
you have set forth in ] 

Spon. ^ 

A: Great. I am comfortable wS 
zjl And ftogi^what you have made i 
za haveP^Me gh amendment to the qi|cs^n I got 
3*1 catli^l^my depospS8^hen )^^m^|>fonncd 
rd r baa«»„ai^ we ihtp^ifean exercise about 





Krosrtick 

u know, what is an i^^^^choice, but 
ight with you. 1 will offer 
terpretation of that 
interpret it as meaning 
informed choice. thaftST^'fftpice based 
information, and if: 
case don't do that. I 
VC defined — - 

it is a uutology. , 

uuiology. so let's 
5:20 — ' 

ion't want to play a game.That 
interpretation that I can personally 
ith If you want to offer a different 
rflon of what informed choice would be. 
become a meaningful question, but the 
uld — 

Q; May — I am sorry, I intetrupted 
HI May a rational person make a raikmal 
i| decision about smoking without knowing the accurate 
21 health risks, as you have defined them? Can you 
H answer that question? 

*1 MR. HEFTEH: Objection. 

SI A: I can't for reasons ihai 1 aniculatcd 
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[11 Krosnick 

PI during my last deposition and today, which is the 
: 01 term 'rational'' is one I cannot settle on a 
H) sensible definition. 

PI Q: So you will not be able to tell the jury 

ts) how much information it is that you believe one 

tn needs to make a decision about smoking; correct? 

PI A: That's correct. 

PI Q; And you also cannot tell the jury 
|toi whether people are able to make a rational decision 
1111 about srnoking, even despite a lack of understanding 
|ijl of the risks, accurate health risks, correct? 

|ii| MR. HEFTER: Objection. 

|n) A: That's correct. 

(IS) Q: Do you have. Dr. Krosniclc, an accurate 
|t*l undersunding of the health risks of smoking’ 

(17) A: Let me answer that in the following way. 

Ii«l Ido — 

(19) Q: How about yes or no first and then 
(70| explain? 

pi| Do you have an accurate undersunding of 
P3) the health risks, yes or no, and then you can 
laa explain, as you have defined it? 
p<l MR. HEFTER: Well — 

psi Q; And what that means, and I will read it _ 
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iti Krosnick 

PI again, you can look at it in paragraph 43. 

Pi MR. HEFTEH; Objection. 

HI Q: Do you believe smoking definitely 
(s) increases a person's chance of conuaciing some 
m specific diseases such as heart disease, lung 
(7| cancer and emphysema? 

IP Is the answer yes? 

PI A: Yes. 

iiH) Q; Do you hold those beliefs with extremely 
ini high certainty? 

M!) A; Yes, 

|i3i Q: Do you accurately recognize the extent 
[14] to which a person's chances of contracting these 
itsi diseases is increased by smoking? 
liq MR. HEFTER; Objection. 

|i7i A: That's the piece of it I am having 
(14) trouble answering. 

[T9| Q: I know you are. 

(SO) A: And I can tell you why. I accept the 
pil scientific evidence 1 have seen so far on the 
pji relative risk of lung cancer. 1 have not spent 
psj time looking at information on relative risks for 
p4| other diseases, and so therefore, 1 am not in a 
psi position to assess whether my beliefs about 


Page 534 


•age 531 - Page 534 (66) 


M i n-U-Scri ph9 


SPHERION DEPOSITION SERVICES 


http://legacy.library.ucsf.edi:/!liiit/ijyq07a00/(p(!lfA/.industrydocuments.ucsf.edu/docs/ryhl0001 


52434 5549 




O-UE CROSS AND BLUB SHIELD v. 
PHUJP MORRIS 


JON A. KROSMICK 
March 12, 2001 


2—t7 22;t3 25—172317 
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IT) rclaOvc risks of emphysema or heart disease or 
{3| throat cancer or anything else is accurate or not. 
HI I will — 

|S| Q: Let me ask you this question: Do you 
know what the relative risk is. the increased 
tn revive risk associated with smoking or heart 
^se? 

A: No. 

p Do you know what the increased relative 
is as.sociated with smoking for emphysema? 
A: Let me be clear when 1 say no I am 

here the followtng^ndard. I have spent 
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looking at Surgeon 


rcpKins and I am 


fhsiSenliTivc to the fact that reixtrts provide 



if information about^lati 
' |i7i vac^iis conditions, and s4 tK 
■tm. f^a^ ssarily a simple an; 

! isn’t a simple answi 

yielding young i^in! 
pt) spoke of is specific to th* 
day. So, in other words, 
'^i.sease and emphy: 
moking. jqglsa^ocs li 



Of CO 




Iocs. A 


3 16 


isk under 
lually isn't 
is in my survey, 
relative risk of 
cause the 13 I 
of 20 cigarettes 
pc risk of 
iics with the dosage 
er. 

dy would 
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d relative — 


I to know that as wei 
Sfeion, right? 

HEFTER: Objection^ 

No. 

They don't need to don’t 

I to know the dosage’ In oth^ words, does a 
need to know the! 

^sc me. 

/hat do you mean - 

gnizing the extent person’s chances 

^ntracting these disc^csisinereascd by 
g? What do you mean by that? 

I mean accurately perceive the relative 

^r lung cancer given smoking. 

And whai is that. 13? 

HEFTER: Objection. 

1 3 for a particular dosage 
Q: All right. For the same particular 
(30] dosage, do you know the increased relative risk of 
[71] contracting heart disease? 
izTj A: There wouldn’t be an increased relative 
psi risk.There would be a relative risk. 

134} Q; Thank you. 

[TSi A: No. 
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Q: The same for emphysema. Do you know 

what it would be? 

A: Let me be clear again. I don’i know tt 
lo a standard of confidence based upon looking at 
documents, the way I speak about 13. In other 
words, I have perceptions of these things. I can 
tell you my (icrccpiions just as all of the SRBl 
responses had perceptions, but in this interview 
you asked me, what is it. Being under oath and 
being very sensitive to needing to make statements 
here based on expertise, I just want to be clear. I 
can't as an cxpicn offer you the correct answers to 
these. 

Q: I didn’t ask as an expert. 1 am asking 
you, do you. Dr. Krosnick, have sufficient 
information — let me ask you this: Do you have 
sufficient information to make an informed decision 
about smoking? 

MR. HEFTER: What is the relevance of 
that as to Dr. Krosnick? 

MR. WILLIAMS: Hold the objections. 

Q: Go ahead. 

MR. HEFTER; I object to the question. 

Q; Do you have sufficient information to 
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Krosnick 

make an informed decision about smoking? 

A: As 1 said before, I cannot define an 
informed decision. 

Q: Do you know what the relative risk is in 
connection with stroke for smoking? 

MR. HEFTER; How long was the person 
simking — 

MR. WILLIAMS: Would you objccL> 1 am 
going to use the same dosage levels he 
started with, okay. He wants — 

MR. HEFTER; Then ask the question 
that way. 

MR. WILLIAMS: Absolutely 

MR. HEFTER: Ask the question that way 
rather than generally 

MR. WILLIAMS: 1 will ask the 
questions as 1 see fit. 

MR, HEFTER; You just said you were 
going to ask him the question based on the 
same dosage that he said. 

MR. WILLIAMS: Do you want to get him 
Out of here? 

MR. HEFTER: 1 would, but you are 
asking him questions about what he 
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I 2 | personally believes, which is completely 
n irrelevant. 

HI Q: Do you know what the increased relative 
isi risk is or relative risk Tor a pack-a-day smoker to 
n co^iacci^stroke? 
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No. 


No. 



same question for bladder cancer, 
me question for emphysema, 
me question for heart disease. 


u know what the re 
^ge level for stroke? 



er cancer? 


'A: No. ' 

Q: Heart disease? 

I yoi#opinion, Dr.Kiosn lo 
^recognt^^^^xiem 
cmsmi^ contiac#iPl^n di 



a person s 




-17 
Krosi 

hysema is increased 
ER: Objection 
know. 

will turn to paragra^h^48^of 



Page 540 


sk.and why don't ; 

I don't know the tr^ 
can't match my per 
ss whether I am 

i| I take itpthcn.you 

ai if you^^gre an accurate perception of those? 

3) A: correct.That's why I said I 

4| don'^now. 

si Mt fcWS^ ER: I am just going to raise an 
** entire line of questioning 

7| for tt ^re^rd as irrelevant. 

•) Q; 48. you are reviewing here 

n polls done by the Gallup organization, 
d Do you sec that? 
i| A: Yes. 

at Q: Those were polls you indicated earlier 
3* you had some deal of confidence in. given the 
4| status of the Gallup organization? 

5) MR. HEFTER: Objection. 
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I’l 

izi A; Yes 

PI Q: And the question was. down at the bottom 
HI do you see. “Do you think cigarette smoking is 
PI harmful or not," and then you track how that number 
(6i has moved since 1949 
n Do you sec that? 

(»j A; Yes. 

t^ Q: 40 percent in '49, 1949,and 30 percent 
{!« in '94,10 percent in '77. 

( 11 J Do you sec that? 
tiJ! A: Yes. 

[131 O: And 5 percent in 1999. 
ini Do you have that? 

|i5| A; Yes. 

lic{ Q: Can you draw any conclusions from the 
||i7| iact that 5 percent of the people, the population 
ii(| of the United States in 1999 docs not know that 
(IS) smoking is harmful? 
pai A: Well, 1 would say they do not believe 
pt) that smoking is harmful. 

[171 Q: Well, let's probe as to why. You are an 
IZ3| expert, of course, on why people scan to smoke and 
[Z4| here you have 5 percent of the pieopic thinking it 
ITS) is not harmful, correct? 
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Ml 

[71 A: Yes, 

PI MR. HEFTER: Objection. 

HI Q: Which is consistent, is it not. with 
1 ^ your SRBI interview, which found 5.7 percent of the 
m people think that it is safer to smoke, right? 

[7] A; Yes. 

lo Q; Now, can you offer any opinions as to 
Pt why even today wc have 5 to 6 percent of the people 
[Id who think that smoking is not harmful or imy even 
[ 11 | be, may prevent disease? 

Mai A: I can speculate, but 1 am not aware of 
[laj direct research that has explored the issue. 

[i4{ Q; Could you conclude that that 5 percent 
l<5i of people or 6 percent continue somehow to be 
ii^ deceived by the tobacco industry as to whether 
1171 smoking is harmful? 

|iai MH. HEFTER: Objection. 

|i9i A: No, I can't infer one way or the other 
Pd of whether they are or are not deceived by the 
pi| tobacco industry. 

pai O: Can you conclude whether these people 
pai for some reason have never been exposed to 
p<i aniismoking messages? 
psi A: No. 
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Krosnick 

O: Can you speculate as to why 5 percent of 

the people today don’t think that smoking is 
harmful? How can we explain that, Dr Krosnick? 

A: Weil, in research that 1 have done on 
tiers like this. I have seen people who are 
sk^tical about authority figures' assessments of 
in general and who sort of view scientine 
udics as not terribly reliable, that you can kind 
of .i— that interested parties can buy a scicnti/tc 
y to show anything you want.They hear 
co^iciing messages in the news media, some from 
lih professiortals. othjKI from the tobacco 
stry making opposiu^^Pl^nd they conclude 
th^y can’t believe what tell them, they 

to reach a iudgmer»ton tftiSrown and they may 
lo^ at individuals who ihc^Kavp seen over the 



Irs smoking and mak 
mple, changes in the 
iduces and incidence: 
personal experience, th 
onsmokers I know get 
i^ate that the smok 



cs about, for 
d that smoking 
^case, and from their 
y, you know, the 
iseases at about the 
d so 1 would 
jse. 
m ndw to 




results on 
nd you say these 
.sionthat the 
and former 
the increase in 
^ smoking, 
t right? 


graph 72, please 
Sure. 

Yes, I do. 

You arc talking abc^te.y 
r .SRBI survey here, I believe, 
support th 
ma/titity of America^ 
kers GuiTcntty undeii 
of getting Umg canc| 

Do you see that? Did? 

: Yes. you did. 

Could you make the same statement if we 
t^)t out the words ■’increase in"? In your opinion, 
rosnick. docs the vast majority of American 
ent and former smokers currently underestimate 
of getting lung cancer due to smoking? 

A; If you wanted to take the word 
"increa.se" out, you also have to take "due to" out 
anti change it to, for example. "anK>ng smokers," 
something of that son. 

Would you tike to make chat change as 
well? 

Q: Yes, Go ahcad.Takc out "due to 


25—t7:33:S5 

Krosnick 
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I'l 

PI smoking"? 

A: Just Change it to "among smokers." 

IS) O: All right. 

!5) A; So now it is “The vast majority of 
If) American current and former smokers currently 
R undcrcsiimacc the risk of gening lung cancer among 
laj smokers." 

PI Q; And you believe that that would be 3 
[toi true statement? 
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l"l 


Let me withdraw that and ask this 
|i7| question. Dr. Krosnick. 

Ii3) Do you believe that the vast majority of 
(141 American current and former smokers currently 
MS] underestimate the absolute risk of gening lung 
116 ] cancer due to smoking? 

A; Right. 1 understood it that way. 
ti») In order for me to answer that 
Ii9| question — 

Q; I am sorry, we have to stop for another 
121 ] reason. 

I 22 I THE VIDEOGRAPHER: The time is 5:34 p.m. 
ITS) this completes tape number 3 of the 
(24) continued videotaped deposition of Jon 
I75j Krosnick. 
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Krosnick 

(Recess taken.) 

THE VIDEOGRAPHER: The time is 5:40 p.m. 

|4| This is tape number 4 of the continued 
(SI videotaped deposition of Jon Krosnick. 
m BY MR. WILLIAMS: 

m Q: Dr. Krosnick, you have the opinion and 
m you have expressed to us that the vast majority of 
PI American smokers underesiimate the increase in risk 
(tot of getting lung cancer due to smoking, correct? 

A: Correct, 

Q; Do you have any opinion whether the vast 
majority of American smokers currently 
(<4) underestimate the absolute risk of getting lung 
(tsi cancer from smoking? 

A: I can answer that question with a small 
(17) caveat, I just want to carefully get the caveat. 
i<8i The caveat is — excuse me, the answer is no.The 
I'Si caveat is to really answer that dcpiends upon 
1201 knowing the true absolute risks.and the only 
l 2 il evidence I have to date on the true risk comes from 
( 22 ) Kip Viscusi’s analyses. I am uncomfortable with 
pjj the calculation method used to generate that 
I24J rtumber, so 1 am interested in seeing that number 
| 2 S) calculated in a way that seems more compelling to 
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111 Krosnick 

P) mc- 

P) On ihc assumption that the true number 
|4) is not very different from the numbers that he 
IS) offered, 1 would answer your question no. 
m Oi>^he assumption that the number is the 

p) one he offers, which is around 13, correct’ 
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p) c^e he offers, which is around 1 3 , correct ' 
m between 5 and 10 in his 

(91 wrings, but — 

101 l^j^gg^rry, 1 stand corrected Between 5 
111 a^lOwlhc absolute risk. 

lai have any reason chat? 

isi ^Q; AK'ha't do you think the abnlutc risk is? 

isi PSSi^^^ER; Objection 

IT) A: As ^y. I have not calcula to^jj^ 

i« I question it is bascoonhumethod of 

is| as he describes it 

ai| Q: How would you calculaterisk? 

ZD indhp^nls ^cr their life course, which'is what 

ing ahni^^i^ detera^iwj^^rther or not 
ts» tlK^^BaBEe^smokcrsjBSIIS^at dos4iegs,and then I 
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I ( 1 ) Krosnick 

PI today, to obtain an absolute risk measurement, 

I3i correct? 

W MR. HEFTER: Objection. 

[5] A; Only to my knowledge now.There may be 
IE) data available today that could yield a more 
PI convincing and accurate assessment. 

I«] Q: Between now and trial, do you intend to 
(91 obtain better data as to what the absolute risk is 
liq of getting lung cancer? Is that one of the things 
pi) you want to do? 

tiT] A; In general, of getting lung cancer in 
( 11 ^ general? 

Ii4] Q: From smoking. 

(IS) A; From smoking. It is on my agenda to 
(IE) continue to explore getting better figures, yes. 

[!/) O: Assurning — let us assume for the moment 
(ISI that the absolute risk of smokers gening lung 
(19) cancer is 10. okay? 
tiai A: 10 percent. 

pt) Q: 10 percent. Do you have an opinion 

paj whether Americans overesiimaie or underestimate the 

rm absolute risk? 

PEI A; Some overestimate, others underestimate, 
ps) Q: What percent underestimate, from your 
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II] Krosnick 

PI least I 2 percent of Americans would underestimate 
PI and at least 78 percent would overestimate. 

Ml Q: Have you done any calculations with 
IS) respect to any other disease thai is associated 
(«; with smoking? 

1 am sorry, what is the question? 

Have you done any calculations with 
Spect to any other disease that is associated 
"|ioi wit(i smoking? 

1 - 

I am sorry, I thou^i you said before 
12 (jcrccnt underest^^ted? 

At least 12 percent, 

1; And 78 percent ovi 
At least 78 percent 
^That doesn't add u 
That’s correct Thai 
t." 

What about the oil 
A; Sec, the way this ta' 
m^able 5. which I mcntioni 
answer is 10.1 c: 
aning o Cjjh^ ablc c! 

"arc^t 10, bc^^^]thc 


Page 551 



P'l 





46:43 




:rcent? 

tied, 

, you said the 
mthc 

w many people 
are at 10 p>ercent 
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o arc between 5.1 
Id be that of 
them arc at 10. 
could be that 
case they all 


tween 
jpercent of 
low how many of 
at 10 1. that 
inclined to 


Jumped in with the | 
bent and 10 percent. 

■ 8.4 percent of pcoc 
yhich case they arc c|s 
^no|kc of them are at 10, ii 
acresuntatc. 

Similarly, the fjcopic ’ 
and 15. if — 1 know^(«t^^ 

^ptc arc in that range. ^ 
i are at 10.1. If all of y 
I close to 10 that we mght 1 
I them off to 10 and say they arc accurate So 
S’s why 1 had to describe it this way. 

Jn other words, there is this group of 

creent of people who are kind of unknown, given 
^way this table is formatted. 

^ow. you menttoned Dr. Viscusi. Have 
[i9i you met Dr.Viscusi? 

1201 A: Not face to face. 

[ 71 ) Q: How else docs somebody meet somebody’ 

ITT) A: 1 have spoken to him over the phone. 
lMt Q; What about Dr. Hanson, have you met 
pv) Ur. Hanson? 
psi A: No. 
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ii] Krosnick 

Q; Have you ever spoken to him over the 
PI phone’ 

)«l A: No. 

15| Q: Let's go on to a few more questions 
I6| about your exposure groups and your 
[71 motivation-to-quit index, okay? 

I «1 A: Sure. 

PI Q; You have a number of variables, do you 
[lOI not, the first variable being regret. 

[M] A: Can I ask you where the information you 
1171 are getting — 

lt3| Q; Paragraph 90 of your report, 

114] A: Okay, I understand, 

iisj Q: And then you establish a scale with 

[iq respect to the regret variable and you have certain 

[ 1 ?! answers: Do you regret a great deal, quite a bit, 

[isi somewhat, or a little. Do you sec that? 

|i9| A: Yes 

pq Q; And then you score those from 1 to 5. 
pi| A: Yes. 

[77] Q; Now, docs somebody that regrets smoking 
CT a great deal have five times the regret of somebody 
I74| who said he wished he never started at all? 
i 2 si A: That Lsn't how this scale is treated 


2—17:48:52 25—17:49:41 Page 554 

iii Krosnick 

m anatyiicatty. It's not a ratio scale and so — 

PI Q: It's not a rliio scale. So you can't 

(4) say that somebody who got a 1 had five times the 

IS) regret as somebody who got a 5? 

(«l A: That's correct, 
m Q; It is an ordinal scale; is that right? 

(i) A: It is an interval scale. 
isi Q: Inrcrval scale. What is the difference 
lio) between an interval scale and an ordinal scale? 
fill A; An ordinal scale is one where each of 
JIT) ihe points you know are progressively moving from 
ii3j one end of a continuum to the other, so in this 
[141 case we arc moving from no regret to a great deal 
[15) of regret. 

Ii6i Q: That’s an ordinal scale? 

[i7| A: That would be ordinal. It turns out 
(i»l some interval scales arc also ordinal.An interval 
(iq scale has ordinal properties plus an additional 
poi factor, which is that you can specify the distances 
171) between the points on the scale. 

(77! Q: That is an interval scale, correct? 

[731 A; That's an interval scale. 

[74| Q: If you can sfjecify the intervals berween 
psi the various — 
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Kr^fnick 

A: Points. 

Q: — points, you have an interval scale. 

A: That's correct. 

O; If you cannot quantitate or quantify’ the 
ges. it is an ordinal scale? 
erally speaking, yes. 

I'lake it then you would describe 
n t^^^estfiypcs of responses as ordinal responses’ 
nq 

' not? 

V: I w^uld call ihcnt interval, respttnscs for 
ms 1 just told you. 

|can't quantify the di 
etween a I, a 2 and a 3, can yi 
jiely you can, as I c: 

171 earticr. 

’A 

tq ai 

Can yeiu say that somebody five 

in times — who scores a 3 has on< t regret as 

23) somfltotly, who has a I 

lo^epeat, no, because jot^a.tx 
Jif latios, i^^wwrvals,! 

: is the in^^^^hcre? 


Pago S55 




? All right, then, we 




17: 

Kros^ick 

ntify to have an inte 
— in other words 
studies that have 
extremely, very, som: 
ssibic to quantify the mcam 
terms. 

words, if 100 means as triuc 
rson can possibly 

at all, how much regret 
t, and that turns out 
mething of that sort acioss a large 
udies, so you can quantify the meanings 
these terms and then treat this scale as 
Ic. 

^I'a ratio scale because it is a 

erval scale ranging from lero to 100 or 
ximum possible — 
q Q: I sec. So what you arc saying is you 
q can take ordinal data, assign a number to it and 
t| make it an interval .scale? 

71 A: Precisely. 

q Q: What is a cardinal scale or a cardinal 
t| variable? 

q A; I don't remember. 
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Krosniek 

121 Q; You don't know what a cardinal variable 
|3| is? 

l<l A; 1 don I remember that term. 

(B| Q: 'What about a ratio variable? Do you 
ici know that term.’ 

m A: I am not — I can make an inference 
i<! about what it means, which would be a variable 
iq where it is akin to a logarithinic variable where 
jioi each unit movement represents ratios of two numbers 
[ 11 ) to one other. Again, it is not a term 1 am certain 
|i ?1 of the dchnition of. 

nil Q; Arc you familiar with the term "interval 
rui variable?" 

[151 A: 1 have used it. 

(i6i Q; Today, here? 

un A: Yes. 

[lai Q: And the interval variable is what you 

iiq arc talking about by taking the ordinal variable, 
pvj assigning a number to it and coming up with an 
l?i| interval variable? 

[221 A; Yes. 

1131 Q: Now, you calculated, sir, the means of 

1241 this — you tiansfomicd — you took the averages of 

nsj this motivation to quit variables: is that right? 

2—17:63:18 25—17:54:15 Pag« 558 

(ij Krosniek 

nn MR. WILLIAMS; Let me suike that. 

Ml Q: You calculated an average ora mean on a 
|4! nx>tivation-to-quit index, correct? 

IS! A; Yes. 

IS) Q: And that's the material, that's the 
m numbers that you have presented in your report? 
lai A: t presented some means on that scale, 
m yes. 

iiDI Q: Right. Did you present any median data? 

[Ill A; On that scale, no. 

[131 Q: And why not? 

[131 MH. HEFTER; Objection 

1141 A; There was no — it was not called for in 

[isi the analyses thai 1 did. 

MSI Q: Would it be wrong, bad science, to have 
|i7i presented this in a median format? 
iiBi MR. HEFTER: Objection. Asked and 
[III answered. 

1201 A: Yes, 1 have answered it earlier, and 

I3ii what I said at the time is that one could do the 

I 22 i analysis. It is essentially never done with 

[731 medians, and the median approach is a less powerful 

[24] way, which would increase the likelihood you would 

I25| reach inappropriate numbers from the analyses, so 
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KrosnicH 

(heitforc, J didn t do it. 

O: Well, 1 did ii and 1 am going io show 
that to you. 

MR. WILLIAMS: What I would tike to do 
ark this as Exhibit 2 for identification 
if I could. 

rosnick Exhibit 2, one-page chart 
^^cd "Medians - Individual Measure of MTQ 
ted," marked for identification, as of 
ate.) 

Dr, Kiosnick. I am not asking you to 
this on face value,the purpose of my 
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ions right now is just^ 
of calculations. 

hipi: HEFTER: For the rlcoWn ; 
an objection to this i 
d. 

. WILLIAMS: Sure 
Q: Would you agree th^ 

;<:unitc calculations of ih 
ions, that there w< 
cen any cxpo| 
Sur&on GenosijLXiobacco,,, 








he the accuracy 


nil just 
it on that 


were the 
from your SRIil 
lO difference 
p$; control. 
Surgeon General 
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[11 Krasnick 

fz) A: Yes, but not for the reason I think you 

P) arc trying to ask about. 

Hi Q: Well, why don’t you explain, please. 

A; As I said earlier, a median analysis is 
i«i very crude. When you bring it to data like this, 

(71 alt it s doing is picking the point of distribution 
(81 of. let's call it molivation-io-quii scores above 
PI which SO percent of the sample is and below which 
(101 so percent of the sample is. It completely ignores 
(111 where above and where below those people are. so it 
|izi is a very crude analytic tool, and so, yes, your 
(131 statement is correct, you cannot reach a conclusion 
(141 with confidence about any impact of these 
|!5r manipulations because it is such a crude analytic 
list tool. 

(17) Q: It is a crude analytic tool because I 

(<si have a crude analyst sitting next to me. But just 

(19] take it on face value, all right? 

(TO] All that being said, if you were just 

(71) looking at median data, you could not draw any 

(27) conclusions on the basis of your exposure groups 

(73) and your motivation to quit; isn't that right? 

(74) MR. HEFTER; Objection. 

( 2 si A; 'Yes. and just to be clear again, 1 could 
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CO group? 

. HEFTER: Objcctioif^ 

J ust look at it for a 
No, 

You would not agrcgimiUIUl^t’ 

Correct, | 

i There is no differen^^^^^ medians; 

|d you agree with tha^ 

Yes. I would. 

And you could not just 

ing at the medians hdre 
Yes. 

: And ju.si looking at median information, 
u .coulO noc draw any conclusions one way or 
micr as to what type of smoking 
^vatk>n-to-quit index could be predicted by 
sure groups, correct? 

MR. kEFTER: Objection. 

MR. WILLIAMS: Lci me strike that. 

Q; If you were jusi looking at median data, 
you could not determine any statistically 
significant relationships between exposure groups 
and the moiivation-tcKjuit index? 

MR. HEFTER: Objection 
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lij Krosnick 

(7) not draw any conclusions because there is no 

PI information here from the medians alone that allow 

HI me confidence to reach any conclusion one way or 

|S) another about the impact of this manipulation. 

(si Q: I understand'your counsel has objected 
(71 to this.You would have the information in your 
18 ) database to do your own calculations of medians, 

(») would you noi? 

|io) A; Yes. 

ii') REQ Q. Could you do me the favor, sir, of 

[171 between now and trial — and I know that you arc 

itj) going to be doing a lot more work in this ease — 

(14) if you could add one little thing as a favor to me. 

MS) is to check the accuracy of what I have put in 

(15) from of you as Exhibit 2? 

(17) MR. HEFTER; We will take that under 
(m advisement of whether he is going to do that 
(19) or not. 

(TO) You can make that request to me, don’t 
(71) make it to the witnc.ss. 

ITT) REQ MR. WILLIAMS; 1 am making the request 
(73) on ihe record to the witness and to counsel 
p4| that I would request that he confirm the 
[751 accuracy of Ihi.s, and I am going to ask him 
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it| Krosnick 

121 atx>ut it at trial. okay.> 

O) MR. HEFTER: Wc wiiJ take that under 
w adviscmrnl. 

iq MR.WILLIAMS: You don’t have to take 
m it u|^r ac^sement. I am just telling you 
in wl^t I am ^ing. It's a preview 

u want to say something. 


Pa9e S63 


m Dr.^josnick? 


lavc a copy of it. 
give you a separate 
i it. 


I'O! want me to take a copy of this? 

|ii| Ijg. HEFFER: You don't need to take a 
|izi cop^ 

|iq 

t'<) No|^ 

•iSiJgnE": • have a copy of Cjon 

|iq 4 

Ii7l Q: Haveever—arc you fa| 
nq the^^Sh^^bstantive statistical si| 
iiq ever heard that ter 

pm A: No. 

pi) Q: Have you ever heard the coficept of 
P 2 ] you dt^^pne you might have —| 
pq staiisti^fy si^ificant rclationshipor^ shpuld 
p«t also lo^^^^hat rclat^^^li to dtl^^^^if it 




>q 



ve heard of that. Did you j 
analysis in conneaiq 
sented here? 


conclude that all of| 
gnificani relationshi)| 
'dc substantive sense? 



ie:< 

Krosniqk 

A: 

QtY^ 
iq condu^ 
fsi youw^ 

M A: 

PI Q: 

m statistic 
m report! 

Ap 
Q: 

MRl 
Q: 

A='j 

tq for* as j 
iq Q: At] 

■ 7) confou 

A; ’ 

Q; Did you attempt to determine whether age 
! 0 l across your four exrwsurc groups could have a 
>i| confounding effect? 
p) A: Yes. 

o) Q: Did you attempt to control for that? 

■<1 A: I did control for that. yes. 

■q Q: What about gender? 


conclude that all of p 
S: Strike that. 

control for age in your study? 
not sure what you mean by "control 
flic term. For example — 
aware of the concept of 




I’t 

PI 

PI 

H) 

P) 

rq 

m 

l») 

I ID] 

("I 

III) 

|131 

I'aj 

(IS] 

(>61 

I'h 

||IB| 

( 10 ) 

!30| 

P>1 

P*I 

pS] 


['! 

PI 

P) 

W 

(SI 

IS) 

P] 

IS] 

PI 

|10| 

I'l] 

|I2) 

(13) 

(<■*1 

1 ’ 5 | 

IIS] 

cn 

|i»i 

|19| 

po) 

p’l 

P51 

P3) 

P‘1 
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A: Yes 

Q: What about former smoking status? 

A: Yes 

Q; Did you attempt to control for the fact 
that sonic picoplc heard zero messages, some people 
heard three and some people heard six? 

MR. HEFTER: Objection. 

A; You wouldn't control for those things. 

1 analyzed the effects of those things 

Q; So the answer is no? 

MR, HEFTER; Objection. 

A; Just so it is clear, it is not a 
meaningful question in our statistical language, 
just so you ~ if it is a meaningful question, I 
misunderstood your earlier questions. 

MR. WILLIAMS: Let's do this 
Adam, why don't you ask your 
questions, if that's all right with you. and 
1 will reload, so f don't have to take any 
time right rxiw to break. 

That is all right with you? I think 1 
am done, is what 1 am trying to tell you. 

Actually,before I do that, let's mark 
this as Exhibit 3 for ident ification.These ___ 
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Krosnick 

are the materials we received today from 
counsel. 

Is that right? 

(Krosnick Exhibit 3, multiple 
documents received from plaintiffs’ counsel 
on Match 12.2001,2:20 p.m.. marked for 
identification, as of this date .) 

MR. HEFTER: Just for the record, 
these are multiple documents, but for the 
sake of, in the interest of time, we can 
mark it all as one. 

MR.WILLIAMS: Do you have more than 
one copy there? 

MR. HEFTER; No, but it is a 
collection of separate, multiple documents. 

MR.WILLIAMS: I see.about an inch 
thick. 

Q: Is lhai right. Dr. Krosnick? 

A: Sure. 

MR.WILLIAMS: Wc just got these today 

at 2.20.WC are going lo take a look at 

them, wc are going to reserve our right to 
redepose this witness prior to trial, and 
with that, 1 am going to turn this over to 
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,,, Krosnick 

!21 Mr. Sicin and I am going to sec if 1 have 
Pi any more questions 
ft) (Discussion off the record.) 

EXAMINATION BY 
MR. STEIN: 

^[71 ^ Good evening. Dr. Krosnick. My name is 
Stein, I represent B.A.T. industries. 1 have 
^^^st a couple of questions, and I appreciate the 
^ [101 ftctilhat you arc soldiering on so late in (he day. 

included as part of what has been 
%72) marked as Krosnick Exhibit 3 earlier today arc 
^^k^mesof several newspa^j^ aniclcs that quote 
yiM^K^mcnts by various totuc^^^^npany executives. 
I right about ■■ 

^^^^^Could you just rcfrelsh'T^'^collcciion 
^^^as^ what purpose thosc^^^^^ervei* In other 
fti^^mtjds. what do you intend^ i^gthcm for at the 
in this case, if you ar^^^l^ip make any 
[?>) use of them at all.’ 

A; My purpose in look mg at th^sc documents 
prove my sense o^w^^^wut what 

tic btUoiliccP comciany employi 


g the la 
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xtut what 

compiany employees 
evidence on the 


articular 

nlaintiffs' counsel.’ 


Sring them up 


^^N»|ionship of smoking 
[^^(Sfi Now,did you look a^^^^her 
i^^|tatements by tobacco c ornta^ ^^xecutives or is that 
[^^lll^ole cluster of docun^^^abai you have 

l^trvfewed? ^. 

MEFTER; Objection. | 

I^im| I have looked at 

Now, the source of ^^g^articular 
M^documents. did they coii^^^^^laintiffs' counsel.’ 

How did you go abc^^^^^^ring them up 
purposes of this deposition? 

1 sat down — well. I didn't gather them 
(i^^p for this deposition ai all. I gathered them up 

own learning, sat down at my computer and 
search for books in the Ohio State library 
M^iSMafcdg<based on the keyword tobacco, and that 
( 1 ^ yicidco a very large number of books, and 1 staned 
poi going through them and read titles to sec what 
[211 seemed potentially helpful in teaming about the 
172] Issue I just mentioned and picked the first 12 that 
pai I came to that seemed reasonable — 

]7>1 Q: 1 was not talking about the hooks. 1 
I 2 si was talking about the newspaper anicles. 
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PI Q: How did that collection come about? 

Ml A: I have been collecting my own newspaper 
[51 articles on occasion.Thosc are the only other 
|6| newspaper aniclcs that I have, Perhaps — it 
m could be there arc some newspaper articles in what 
P) are called the exhibits that were used for the 
PI depositions taken in this case from Blue CrosiBluc 
[lot Shield subscribers. 
iri| Q: And you reviewed those? 

[I?] A; 1 did read the exhibits at some point. 

|i3i I don't remember the details of those. 

[■<1 Q: The newspaper articles that are appended 
|isi to Krosnick Exhibit 3. are those articles that you 
[lej looked at from deposition exhibits or arc those 
(171 articles chat you pulled, yourself, off the 
[lai Internet or arc those aniclcs (hat came from 
|iBI plaintiffs'counsel? Do you have any specific 
pq recollection? 

pil A: All of those were provided to me by 
P2l plaintiffs'coun.sel late yesterday evening, 
paj Q; Do you know whether or not you had seen 
i ?«1 any of those articles before? 
ps) A: First of all, 1 have not read them all 
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( 1 ) Krosnick 

12 ] carefully.The ones 1 looked at, I don't remember 

CT seeing,but I may have seen. 

Ml Q: Did you discuss with counsel yesterday 
IS) those articles? 
i«) A: Yes. 

171 O: Let me direct your anemion to one of 
(S! the articles which has been marked as Plaintiffs 
w Exhibit 1862, which 1 will represent to you is one 
[iq of the documents that is attached as pan of 
M<| Krosnick Exhibit 3. 

[121 Let me just hand that to you and ask — 

[13) MR. HEFTER: For the purposes of your 
[141 examination, can I just take a look at the 
|is) exhibit so 1 can have a copy in front of me? 

|isi MR. STEIN: Sure. 

[IT] Q; Is that one of the articles that you 
[III discussed with plaintiffs'couruct yesterday? 

[IS] A: 1 don't remember. If it was in the 

po) packet you received, I think it’s very likely to 

pi) have been one that I was handed yesterday and was 

ITT) the subject of discussion. 

178 Q: Do you know whether chat was the first 
P4) time you had seen that article, yesterday? 

PS) A: I think it is, but 1 don't know for 
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PI 

IZ 1 sure. 

P 9 Q; Now, the article ihai we arc talking 

(*) about is dated October 31.1996, and it, apparently 

isi it is a Wall Street Journal anicle. 

Can you confirm that for me, please? 

A: V^l, it says WSJ. 1 suppose that's a 
ile inference, yes 
?aU Street Journal? 

AiYcs 

|in, you don'kknow, because you had 
,^it before yesterday? 

^ 1 am sorry, it says als^ 

If reporter of The W; 
jumaiV^so that seems pretty fecly, 

:.you understand, siil^at t! 

! ,,5 ? 

[i7| lecoupi^eiit case that seeks t 
incurred by Empire 
rs smoking? 

Q: And the earliest year iha 
’^mages in this case 
n^ur understanding' 
lE^ER; OteoraliPn 






October 
Id have had 
related costs 
Sriferds, the 

have been an 


Page S72 

Id you agree with mi 
Pall Street Journal attic 
do with any of the 
y Empire in 1992? Ii 
who would have — 
ity for a subscriber tQha^s^n that 
r any claim to have ^^^^mserted in 
with any statcmcm^uy^d|^rticlc 
:obcr 1996: isn't ihatngii?^ 

ER; Ob)ection. 

— just CO be absolutely careful, 
just restate it one more time. I 
(14J thinl^^^w the answer, 
tiH Q:®L^Thc anicle is dated Octol>er 31. 

|i« 199^^^itc is assening claims in this ease for 
riTl cost^^^^d commencing back in 1992.That 
ii« anic ^asBa^H^ is statements by a tobacco company 
list executive. 

taoi My question to you simply is whether or 

mi not it's possible for that article to have had any 
Ta\ impact on any claim by Empire in 1992. 

231 A: No, 

»l Q; Or 1993? 
asi A; No 


2—1809D1 2S—18:09:48 
iii Krosnick 

(21 Q; Or ' 94 ? 

PI A; No 

Ml Q; Or 93? 

|S 1 A: No. 

IEI Q: Or even '96? 

(7) MR. HEFTEH; Objection 

I8I A: Thai's less clear. 

PI Q: And let me ask you the same question in 

( 10 ) connection with any decision by any smoker who wa.s 
(1 ij an Empire subscriber, the staiemcms in that 

( 1 ?) article would have had no impact on any 
(13] smoking-rclaicd decision by that subscriber in 
|i4! 1992,'93,'94.'93, and part ofl 996? 

|i5j MR. HEFTER: Objection. 

I 1<1 A: Correct. 

loi Q: The SRBl survey didn't ask any questions 
ii«i about that anicle, did it, to your knowledge? 

!'9\ A; That is correct. 

poi Q: And do you know whether or not any of 
(211 the Empire subscribers were asked questions at 
(221 their depiosition concerning that article? 

(11) A: SRBl — 

(24) Q: At their deposition, the deposition of 
psf the 156 deponents. 
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( 1 ) Krosnick 

( 2 ) A: I don't know one way or another. 

(3| Q; You don't know. You have looked at some 
14| of those depositions and you just don't know, 

(s) sitting here today? 

16 ) MR. HEFTER; Objection. , 

(7) A: I have looked at the depositions and I 
is] will have read alt of them by trial, and 1 have 
(SI kxikcd at the exhibits. 1 just don't remember 

( 10 ) vividly whether this is or is not in the exhibits 

( 11 ) used. 

t! 2 i Q: I>o you have the capacity. Doctor, to 
Ii3] analyze the impact of any one spiecific article in 
(141 connection with any smoker-related decision? 

(tst A; Yes. 

( 16 ) Q; How would you do that? 

(171 A: I would conduct a laboratory 
( 18 ) cxpicrimcnl — obviously, it wouldn't have to be in 
(IS) the laboratory, but where J would expose some 
120 ) [jcople to the story and others not, and observe the 

[ 21 ] impact that that has on beliefs and behavior and 

( 22 ) nuke inferences from that. 

(731 Q: Has any cxjscriment like ihat been done 
[74] in connection wiih this article, to your knowledge? 
ttsi A; Not to my knowledge 
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PI Q: You have noi undertaken any such 
(11 experiment? 

(11 A: That’S correct 

isi Q: So sitting here today, you can’t say 
Ml whether or not any Empire subscriber has ever seen 
th\ article, has ever relied on this article, you 
I 1*1 ha^ no knowledge of that; isn't that right? 

That’S correct. 

pT’oi Q: Just this last question 

to this article which you 
may or may not rely on in conjunction with your 

'* »"y “AT. 


Sa^jstrics-rclatcd material, t 
^ you know of silting 
uely on in giving any testi 
HEFTER; Ob)ecticSi.-' 


lent or conduct 
ly that you intend 
in this ease? 


j^l My understanding 
^^^^ustries is a company that o 
^^l^panics, to the exten^^^ 
( 2 ii companies' — and 1 am 
p« arc. exactly — behavior fa cret 
then I cxpiect 

Ph ^pp l^blc to ijig^ com Ranils 
p^^^A.T Ind^^^ To th^W 


at ow^ Amencan tobacco 
^^^brican tobacco 
which they 
credited to B A T. 

£ pinions will be 

then would apply 
ou wish to 


i18:12:36 
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|i| Krosnick 

PI A: Yes. 

PI Q: Regret smoking quite a hit. you give 
(4{ that one a 4? 

IS) A: No. t am sorry, no. Regret a great deal 
|6] gets a !. 

[7] Q: I am sorry, there is some confusion on 
(B| that, all right. We will go the other way. 

(9l Regret a great deal is a 1. right.’ 

(101 A: Yes. 

lii| Q: Regret quite a bit is a 2, right? 

1121 A: Yes, Oh, sorry, let me think 
|i3i Yes, that's right. 

|u| O: This isn't a trick. 

|isi A: Yes, you arc right. 

1161 Q: Regret somewhat fa a 3? 

(171 A; Uh-huh. 

(181 Q; Regret a little is 4? 

A; Right. 

pq Q: And regret not at all is 5, right? 

R 11 A: That’s right. 

P 21 Q: And so you have assigned the same 

1211 quantiuiivc differences between each one of those 

ply 

p*l five possible resfxinses. right? 

__ Ksi A: That ’s correct. 
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them separate, then, ihe y wg uld not. 

You have not madc^^^^^y of the 
g^Q^oraie relation of 8.A/r^^^gKric5 and any 
iSl^^r tobacco company, 

Mfe A-That's correct. i. 

So you don't know Whethefeor not B.A T. 
la^Eh^strics exercises any rir control over 

i g^h^ ronduct of its subsido^s? 

That’s correct. 

You ate not going t o offer ap y opinion 
regard, arc you? 

That’s correct. 

STEIN: Thank you very much, Doctor. 

(1^ BY MR. WILLIAMS: 

|1<S^^S| A few more. Doctor. 

go back to the scale and the 
(i ^jaj^at ion-toouit index, and we will take the 
ii*r»am^c of the tegret variable, and you talk about 
| 20 | chat in your report in paragraph 89. 

(211 Do you have that in front of you? 

(221 A: Yes, I do. 

[ 2 ii Q; And you have five potential responses. 

( 2 J| One is regret smoking a great deal — and you give 
( 2*1 that one a 5. right? 


(21 Q: And so you would agree with me, would 
(3) you not, that you have the same quantitative 
(«l difference between regret a great deal and regret 
(SI quite a bit,as you do between regret a little and 
(*( regret not at all? ’ 

(71 A: That’s correct. 

Ml Q: And you made the determination that the 
|B| quantitative measures 1 through 5 were appropriate 
(iq in the context of those five possible responses.? > 
(111 MR. HEFTER; Objection. 

(121 Q; Who made that decision? 
im A: Who made which decision? 

|i«j Q; That you could say that the difference 
|isi between regretting a great deal and quite a bit, 

( 16 ; for your numerical purposes, was the same as 
(irj saying — as the difference between regretting a 
( 1*1 little and regretting not at all? 

(im A: As 1 said earlier, after consulting a 
(201 large literature of dozens of studies that have 
( 2 i| quantified the meanings of these terms. 1 decided 
(771 that it was reasonable to analyze the data with 
( 2 J 1 these numerical values assigned to the verbal 
( 2 «] answer choices. 

( 2 S) Q; So you are the one who placed the 
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nj Kraxnick 

Bi numeric values wiih the ordinal responses? 

PI A: Yes. 

)a| Q: And the same goes for all of the other 
|5) categories of the going to the motivation-to-quit 

Id il^x, irkluditig unhappiness and lilic to stop and 

171 l&eliho^of trying to quit, correct? 

[d ^l^p^ect. 

PI You came up with the ordinal responses 
'O' is that right, and you assigned 

‘<1 tijc^numeric figures foi^each one of the possible 

i> 

ER: Objection. 

'I know what ordinap^ISjponScs are, 

the words in these QjKestio^ — 

before you did kpois^f^f 
I st^ponscs — these arc 
ipasute. correct? 

ih an ordinal and ai 

measure, yes. I wrote the word; 

III anss|^ choices here and I assij 

aai valu^g^^^m, yes. 

!3| Q ^gd w you dcci 

Ml exa^^^^vich the stop 

25| bctwccr^^^ai dea 


25—1 
Kros 

he same as the diffci 
p stop, and no desire 
Iccision? 

M^H^TER: Objection. 

A:^^^s my decision that it would 
way to analyze ihesi 
this &shion, yes 
lUy, with respect l< 

>r your answers with 
icre wa.s a lot of lite 
pemq^^ft^ne to take responses of this nature to 
assigt^^ptfibers to them and then to present those 
icsup in the terms of a mean or an average. 

remember that discussion with 


Page 579 





Page 580 


ley, you 



Mr. I 

Ai Mocafaw matcIv. yes. 

Qi^Coulan^u just give me the three leading 
authorities that you would cite for that 
proposition? 

A; There really aren’t authorities The 
way this literature comes together is the result of 
my own liieiaturc gathering for a chapter that I am 
writing, and each of these studies, they arc 
published in a variety of placcs.Thcy arc not 
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PI panicularly famous authors, they arc not 
P) particularly people who have invested a lot of 
HI effort in studying these methods, so there aren't 
i5| really authorities in this area 
PI As far as I know, f am the first person 
P] who have gathered together alJ of this literature 
l«l and wrinen it up and analyzed it in the way we 
t9| have analyzed it to suppon the conclusion that I 
|iai described to you So. in other words, there are a 
( 11 ) variety of names of people who published these 
|iz) articles. 

[tai Q; I want you to tell me, when I send the 
(14) crude analyst sitting next to me back to the 
iis) library to find the suppon for the proposition 
iiEi that one can take the types of responses you have 
ii7i and apply a numeric figure to them and then aveiagc 
(IB) those numbers to come up with a final mean, I want 
[iq to be able to point him to the anicles. the papicrs 
(201 or whatever that would permit such data 
pil manipulations. 

( 22 ) So can you just give me what you would 
tw) cite to us? 


|W1 


A: I can answer in two ways.One is that 


ps] what I have done here is in just about every single 
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11) Krosnick 

( 2 ) publication, in every leading psychology journal — 

P) □; That's great. Just give me three, give 
HI me the three best authorities you have. 

[S] A: 1 am sorry,■you didn't quite let me 
(B) answer. 

(7) Q: I'm sorry. You can give the answer, but 
[<l no matter how you answer it, you can’t leave here 
(91 until you give me the three best authorities that 
( 10 ) you have. 

[i<l A: I am happy not to leave here until I 

|) 2 ) answer your question. Let me answer your question. 

[131 So the first answer 1 am gi-ving you, if 

(14) you arc looking for a rationale for this approach, 

|iS| 1 am telling you that this approach is so common in 
119) psychology, for example, as a discipline, that just 
[17) about any article you look at, you will sec them. 

MB) You could take three recent articles off of my 
|i9) vitae, if you would tike, or three articles off of 
1201 just about anybody cIsc'S vitae, open up the most 
I 2 i) recent issue of The Journal of Personality and 
[ 22 ] Social Psychology and you will see articles one 
|23| after another doing exactly this type of thing. 

|24) Q: No. 

I 2 S| A: Now. the second answer to your question 
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PI Krosnick 

ra is you would like to know ihe specific references, 

PI I believe, of three of the anicics among ihe ones 
|4) that I am referring to that have involved having 
(S! people provide numeric estirnaies of the meanings of 
phnses like this which then provide the basis for 
f PI thi^nalysis. 

And by that, I mean to convert those 
^^mcric responses, those numeric figures into 
ucit.a.'ec^gcs. 

i If Oh, I am setrry, now I am confused again. 

f c you better restate the question. 

What you have don^^a^>‘Ou have taken 
have an interval seal 
A! Yes 

HEFTER: Objcctio^' 
to 5? 

■Ves 

You got it from whai 
ed to as ordinal res 
pii more likely than not — c 
A: I didri't follow what 
right, I will Stan 
P'lsS&SSMs have a res 

kion like AOjw^uch 



lly 

bencr than. 




'0:03 



gret the smoking 
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Sion. 
e'ycs. 

\ The responses to th^ 
yes, a linle bit.’ ‘yes, 

|what you — 

No.Those are not re spons es^o any of 
Questions. 

■ I will take your regret 

^ion a great deal. qiiiiea^H?^mcwhat. a 
^ or not at all. 

r Yes, '■ 

You then assign numeric values to those? 
"^Yes. 

You then average all of those numeric 
Bs. correct, and you come up with a 
ation-to-quit index? 

I* 

Q: I am asking you for the authority that 
I 2 DI states that those types of data manipulations arc 
I 2 t| appnipriatc. 

pjl A: Every research methods textbook in 
pai psychology. 

R «1 Q: Give me three, please. 

psi A: I am sorry to say I don't remember the 
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ft} Krosnick 

[?I names and publishers of research methods textbooks 

: ru in psychology that — 1 mean, you know'. 1 can — 
j [t] there's a book by Brewer and Crano or Crano and 
rsi Brewer, 1 don't remember what the title is and I 
r«! don't know when it was published, 
rn Q: How do you spiell Crano? 
i«l A: C-r-a-n-o. 

I9i Q: Crano and Brewer,B-r-c-wnt-r? 

|:oi A: Yes. 

( 11 ) Q; Textbook? 

iiri A: Yes. 

|li31 Q; Do you recall the title? 

|| 14 | A; No, 1 don't remember. 

!|isi Q: Do you recatl when it was published? 

|nsi A: No. 

|i7i Q: Do you recall who the publisher was? 

||B| A: No. 

|ifll Q; Do you recall the color of the book? 
poi A; No, 

pi] Q: Do you recall how big it is? 
i?n A: No. 

pai Q: All right. Can you recall any other 

P41 textbook that would point us to the suppon for 

psi those calculations? 
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1 <) Krosniek 

p] MR. HEFTEH; Objeciion. 

ta; A: I am little not clear on, I guess, what 
(4] you mcari by support for it, because what I am 
saying to you is this is absolutely standard 
(6) practicc.Yoixwill find — 
m Q: Give me an article in which they do — 
lai well, you mentioned — you have wrinen a textbook, 

I [SI right? 

noi A; Yes. “ 

;|ii| Q: Okay. 

jli7l A: It is not a textbook in social 

jriai psychology, though. 

I|i4| Q: Doesn't matter. I am looking for any 
(151 suppon, sir. 

[tei A: 1 don't know that it's in — 1 just said 

[I T to you any textbook in research methods in social 


(181 psychology will describe this and — rO 

I 

1(191 Q: Have you written — did you say you Ga 

RO| wrote a textbook like this? 

pil A: No, 1 didn't, i am sorry, 1 am trying CJ1 

P 21 to be helpful here, but I just don't know — 

(211 Q: Well, you indicated that you have 
P41 written on this issue. 

1251 A; If 1 understand the issue correctly. 
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PI which is assigning numbers to verbal response 
(3| choices, averaging chose numbers to yield and 
M index — 

O; Right. 

—<^have not written a statement in any 
p licaii^n that says you should do that or — 
lu shouldn’t do it? 
k; Or you shouldn’t do it, right. 

It's so commonty^done, it's such a 

an of our work that it's not something 


Pago 587 



pays close anention tcM^ 
making an arguincn 
^ronvention of the research 
r field, and if you 
three anicics that di 
list them for you. 

'tom your CV. 

’ A; Okai’.'Well, then — 

Q; From anybody else. 
A{^^^,^nybody else. I will 
aai actiimiy an^le . 
a»i saying i^^i^nen 

s right.A^^SS^y else 


as) 



2 -* 
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l«j Krosnick 

[ 2 | A: i think that aaswers your question. 

Oj Q: Okay. Do you recall what the subjects 
(41 were? 

(SI A: I just told you 

161 Q: Attitude change.With respect to any 
in particular type of attitude or just in general’ 

16 ] A; Well, each study was about some 
[91 particular type of attitude. I don't happen to 
1101 remember what they were, 
nil Q; You don’t remember any particular type 
nai of anitude 10 help us identify these subjects that 
(lai these articles — 

114] A: You will have no trouble finding it. If 
(151 you do a literature search for Richard E, Petty in 
1161 the Journal of Personality and Social P.sychology 
iiri during the last 10 years, you will find a scries of 
118 ] articles. 1 cannot assure you, but 1 think it is 
1191 likely that you will find among that set three of 
i»l them that used this type of procedure, 
pi) Q; And the last point, sir, you said that 
P 21 you have written on this subject as well, not a 
[231 textbook, but you wrote an article that uses 
[24| exactly the same approach, right? 

[?s) A: Many. 
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mber of 
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Kros^ick 

!. Here’s, 1 guess, an 
PI Richa^^^Petty has published 

W Journal of Pcrson^^^^Social 

15) Psyc^lo»,ai least one a year, ^™tably.’for the . 
n last each of which has‘uscd an^nalyiic 

in app roacl^ ikc this, is my guess. 

be conlideniabout |his^^ 
asking for a guc: 

: Seems like you arc 
confident about need 

Jhc articles and confirm what was done 
d I am happy to do that for you. 
you recall what he has written on 
X would use this approach? 
of his work is on attitude change 
ion. He has done some recent anicics 
Hi processing. 

i«i Q; Attitude change and persuasion? 

■01 A: Yes. 

•II Q; In which journal? 

! 2 i A; The Journal of Personality and Social 
■3! Psychology. He also has published in a journal 
■4] called Personality and Social Psychology Bulletin 
Q: Anything else? 
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[ 1 ] Kfosnick 

(71 Q; Many Just give me a couple, please, 

131 A: Okay. There was an article by Joann 

(♦1 Miller and John Krosnick published in the American 

IS) Journal of Political Science in 2000, line 44 

161 beginning on page 293. 

[71 Q; Thank you.Thai’s on your CV? 

i6j A: Yes. You would like two more, you said? 

[91 Q: Yes. 

[101 A; There is an article by Penny Visser and 
ini John Krosnick published in 19S>8 in the Journal of 
( 12 ! Personality and Social Psychology, volume 73, 

(13! beginning on page 1588. 

[141 There is a chapter by Krosnick, Marayan. 
lisi which is M-a-r-a-y-a-n, and Smith, published in 
1161 1996 in a book called 'Advances in Survey 
|iiri Research." 

1161 Q: Is that a textbook? 

(191 A; No- 

poi Q; Have you written a textbook? Have you 
I 2 i| written any textbooks? 

1221 A; 'k’cs, I have. 

1231 Q: What is the title of that? 

[24) A: It's been published in a couple of 

! 26 | different editions with different titles When it 
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Krosnick 

was originally published, it was called 
“Introduction to Survey Research and Data 
Analysis." In its latest edition, it is published 
as “Introduction to Survey Research Polling and 
Data Analysis." 

^ Would we find the description of the 
mtaliodology in there as well? 

: I don't think so As 1 told you before, 
it's not an introductory textbook in social 
hology research methods 
MR- williams' All right.That s all 1 
Thank you. 
niinucd on following 
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1. STEIN: Thank you| 

. HEFTER: I have ntn 
^time. 

IE VIDEOGRAPH ER: 

March 12, 2001 the 

ataped deposition of'Dr Jon Krosnick, 
I also completes upc I 
rime noted: 6:30 p.ni.) 

NICK 

I and sworn to before me 

.day of _2001. 
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I. CATTY N eiGELOW. RPR. a Notary PiXiJc 
w«Nn and lot the Slate ol New York, do 
cefliy: 

That JON A KROSNICK, the witness 
whose cortrued depasKloo i» hereirbelore 
«el tohh. was sworn by me and that 
such daposiion is a true record ol ihe 
lestimony given by the witness. 

l further cerltfy that I am not 
rotated io any ol the partes to this action 
by blood or mamage. and (hat l am in no 
imeresied m ihe outcome ot iho 
mefler. 

IN WnnESS WHEREOF, 1 have hereurrio 
set my hand this 13lhday ot Mafxd>, 2001. 
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Respondents eho have acconUng to Krosnich a relative risk of 2.0 


Respondent 

Nuaber 

938 

1593 

218) 

3995 


WEIGHT 

Rel Risk New 
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# of Lung Cancers 
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Respondents #no have according to Krosnick a relative risk of 2.0 
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My undevsraduate honors thesis was an explomioo the causes of 




cii^arctte Ezuoiozig siuotts pr^&dolcscents and arioi^sccnts ami was publ i die d ixt the 
^jumal D^vT-JonmentAl Pavcholoty, s top-canlced jooziud in dev«ljopmeotBl psychology. 
This rceean^ was possible because during my ondeisraduate studies and duiing a year 
^fierwan), I was a full-time researcher worldug on a field research project based at the 
ikarvaid University Sdbool of Public Health on cigarette smolnng. which yielded an 


itioiul poblicatioa 


eh 1 am an author. 


6 . Sincepr^^";^vc been a member of the fiKUlties in Psychology and 



litical Science at' 


ilassroom courses fc^ 


I State University. My podtioa there involves teaching 
rad n at es and graduate studeata, as wcU » ono-on-one 


tranusg of graduate fnideotSjin lesccich methods. 



ciences; the. 


: beanracognuedby dieEzlkH. EziksonEariy Career 
r by the Center for Advanced Study in the Behavioral 


Hological Association, the Atneacan Psychological Socie^. 


the Society for and Social Psychology^ 


S. I bav^ 


I or co-authored three pnbUsbed books, over €5 artieles 


published injaumal^OT^ciib^ books, over 120 reseaichprceeniations at professiooal 


Icoofarcnces, and bav 


I over 4 S invited addresses at other umvnsities. Eleven 


|additioiial journal one book are cunently in 4 ie process of being published. 

My journal articles bavea^eared in top-ranked jouznab in social psychology Ooumalof 







scieoce f American Political Science 



poUiical 


C0'd 2 1 »»i6 PEsa B g t 5206 


Oi. CCE9 6S ein 3NIJ.N 


ASnsa ad ud bp-; i i 1002 


22 Nor 


http://legacy.library.ucsf.ed iStid/uyqt7a80i]a#w.industrydocuments.ucsf.edu/docs/ryhl0001 


52434 5594 





survey research tacthedi ^Public C tpiainn Ou«rteriv> . and sociology f American 



Sociolowc al Review. Ammean Journal af .SotnolofvV 

9. Much of my reseaicb lias focused on survey research metbods, inctoding 
bow best to mnastiTC optnions and behavior tbiough surveys, and almost all of my 
^search has involved collectioD and analysis of survey data. 

10. There several other indicorors of my compAcoce as an expert on 




research 
in Gocial ps; 
tes eaicfa me 
iewer lorodMr j 
rived 33 grants to| 
Ni 

piCSWVCKi 

ladinsateicsui 
.ve been invited to 
leseaicb Gtafh> of fedi 






;t, I serve tm the editorial board of foe most picstieiorus 
of Peraonahtv and Soeia] PsvdK»logv3 atnd in 
I^Tc Opinion Qnsrtertvl . Second, I regnlarly serve as a 
Ushers, and professional otpinizatiaas. Third, I have 
yieseaxch. Fourth, 1 curremiy serve on the Boards of 
don Study and the General Sodal Surveys. oadoo'c 
cb projects snidying public opiinon and b^viois. Fiflh, I 
and teach courses on opiaion measuremesit to the 
^ciea in Wssbingtoo, as well u to reaearcluis in the United 


domandtbeNc 

11. 1 have been altced to 000 - 011111100 $ on several issoea, induding: (1) 

hetber Einpize Blue Shield (hereinafter "EBCBS”) subscribers were 

iy cognizant of thfe inyliiations to themscl-ves in believing that cigateae emoking-is a 
cKose of various severe undesirable health consequgDoes, app rwaatiag flie power of the 
causal effect and the addiettveoess of nnoVing, and understanding the array of 
undesirable health consequences produced. (2) whether the conduct of the tobacco 
j^mpanies impacted the perception of EBC3S eubscribns of (he health effects of 


90■d 2rn46pe59ag[6306 
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smoVdos. (3) if EBCBS subjcribes utere not fully cngnizatu In perceiving the 
addictivccaaas aoad severe heiltb risks associated with smoldoc aod/oi the power of tbe 
d eSeci, whether these perceptions would have become more accurate if tobacco 
compBoies b»id publicly statad that they believed gmolfing was addictive and/or a cause of 
severe itndesizabla health ooasoqueoces (comtaty to the oonrac of conduct they followed^ 
■ mH ( 4 ) whether by ^lereaalng the accuracy of EBCBS cttbscribeis' percepttoas Of the 
addicdvBiMBS end of smokinf, the effect of tbe tobacco companies' conduct 

luld have redoced^e ex^lat of sixiciking among tbese iodividuals, either by preventing 
same of thae peop^^^^tattiitg to smoke in the first place or by instigatuig them to 
quit smoldng afio'l^^^^ataitaci 

IZ To a^wer dijese quesdoas, I have reviewed doonments produced by the 


ic liienhire on dgarette smoking, reviewed reports of 
an public regarding dgarette smokiag, analyzed tbe results of 
in diis case by reviewing depesitioa tiaoscripts taken of 
snbscribeis, and designed and Gupervisod the ooodtict of a 
also drawn upon my ptwexisting loiowledge of the 
methods and cigarette amolrine 
if my review of tHis body of evidence, I have reached the 
SCBS fubscribeia currently undcresticnate the bealQt risske of 
done so for decades, (2) statements by tbe tobacco cempaniae 
coatradictiiig and attaddng the public health authorities conclusions over time regarding 
the causal link between smoking and serious di leases and the addictivcDess of eigarettes 
tod EBCBS subacribers' perception of risk, (3) poblic acknowledgcmEnt by tobacco 
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compaoies in the 19ti0s Through to the 1990c that they believed smoking c a t i sw diseases 
and odur wrious health problems wtmld most likely have led mcinbeia of the geneial 
uhUc Till BBCBS subscribets to perceive die health risks of cigarette smoking men 
accciately, and (4) increasing the pnblic's accuracy in recognizing these healfh risks by 
is WDOld most lilcdy have significantly reduced sm ok ing onset and quit rates 

loog these individ^^. 

14. My below are organized is zfae following manner. 1 begin by 

the logic piXd^^ry underlying survey research methods and the principles 

justify generaliriill^ll^h a eystematically selected sample of people to fee full 
ilttioyi frnm ate drawTL Then. 1 explain the moibods Ttsed to sanfele and 

depose EBCBS sobsSerib^Segarding their bclicfe about their smoking briiavior. Within 
^ that can be drawn firom feose deposidems about those 
eliefk those beUe& on emoldng behavior. Next. I review evidence 

^^^^onal ^^^^^teasuring Americans' beliefs about fee health risks of 
oking and finally the findings of a new national survey that I have conducted. 

suRVEYjqsg^^ai methqps 

15. Sorv^^toMSkreh matbods are now a well'established and solidly leapected 
ieotific approach iS^^^ning beliefi; end bdtavior of populations of individuals 

(Babbie, 1990; WeLffiS^TK^saick, & Bowen, 1996). In this sectaon of my report, I will 
explain fee basic and guiding principles of survey mafeodology. 

16. Ccnductisg a survey re s e a rch study involves three principal phases: (1) 
drawing a sample of respondenis to represent a piopulation, (2) coUecting data from feose 

indents, and (3) analyzing the data genetsied to answer the questions of interesc 
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Surveys are usually done for one or both at two reasons: (1) to docimmu tfao prevalence 
of some chaiacteristic in a populatian (t-g., what proportum of Amencans smoked 5 or 

V re eieareRM daring the mosth Of January. 2000), and/or (2) to document causal 

f 

processes thst produce belief and behavior. 

17. Survey resesieh dates back at least to the 19* cenniiy, but the most 
gnificanf developtseats and in^^trovements in the method to^ place duriog the first half 

dmc, icsearcbers came to recosniao that the method by 





fihe 20 century. 

rESpoedents a^cselch^xl fram a population can introduce aubscaotial error to 
ly. Therefore, research on ttovey sampling ha-e 
years, and the resnli of this wnck is an excelleat 
ve ^eihods fiom drawing representative samples of populations, 
^^nd most effective method of sampling general populafions 
In drawing a simple raodoni sample, ihe survey 
sample size and landomly selects a sample of individuals 


3^00 campLng is done, statistical principles permit precise 
documentatioD of asfioctated with the sample in generralizins to the 

I 

population due to ‘'sanqjling error.'' For example, if a researcher is 

mtexested in gaugin^^^^centage of a company's employees who smoked 5 or more 
cigarettes each day ^^^^^suary, 2000, be or she could draw a simple Taadom sample 
of size N fiotn the population of aU employees and interview each selected sample 
metober whether or not be or she smoked 3 or more cigarettes each day ditring January, 
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2000- Imagina that »|)irop<’*^‘^ P (soaiewhexe bac<ve«n 0% aod lOOii) report having 
done so. The lowv bound of the sampliog error of that propciitioi]i, p, would be; 


SE=-e: 1,96 VpCl-py(N-l) 

if one soaght to assess as interval in which the true value of the proportion is at least 9S% 
lOcely to &U. Ibat U, our best guess of the true prc^octioa. in the population of alt 
employees would b< ^i»ved proportion, p, and there would be a 95% ch a tire that 





l^ween (p-SE) sod (p+SE). As the siie of the sample 


^ population. SE gets a bit smaller than the laimula above 
les are much smaller than their relevant populations, so 
ilies accurately to describe the sampling error iitvolved. 
if 38% of 1,000 survey respandeats said that tlieir favorite 
error of that proportion is: 


This mcaos that there 
wfaoae favorite coli 
” of course, assumes ftat die 




SE-± 1.96 >1.38(l'38y(1.000-l) =±3V. 

% chance that the true proportion of people in the popnlation 
is betwerm 35% (38% - 3%) and 41% (38% + 3%). Tba. 
Dple of 1.000 respondents was gmerated by ample random 

sampling. 

21. The fesppnsd rate for a survey is the proportion of eligible members of the 
selected aamjde from whom are in fact collected. In most surveys, the r esponse rare 
is less than 100%. 

22. ITecades of high'^uality survey icsearcb have shown tbai the reliabOity 
.d validity of survey respooses oadcr certain conditions are genetaily quUe high, end 
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respondcDU can be relied upon to provide rcMoiubly eccurste desoziptioaB of their past 


nqKneaces, behaviors, aod opinioas. At the same time, some ways of gathedaf data 


\ 


people yield more reliable and valid measuicmentE than other methods, 

23. Survey quwdoos typieaUy lalee one of two fiums: clossd-cnded or ppeo- 
ded. Closed-coded questions offer ic^xmdents sc±> of aoswer choices amoos wbic^ to 
39C, whereas ope^^ended questions allow reapondems to arswer in their own words 
Bkcd more often than open-eodcKl queations, because the 
ive to administer, aztd the resulting data are eerier and 
bwever, a number of studies have shown that messuremeot 
□ded questions than for elosed-eoded questions. 

I use of qpen-cDded questions ia the process called coding. 

; who read amt interpret open-eoded aaswers and classify 
ories. example, if survey rc^nndeats are esKed, "What xre the things 
job?', coders mi^t be asked to read people's answers and 
:las5ify the zespoodei ^gjferoups of people who mostly like tbair Jobs, people wtio 
y dislike their .people who arc neutnl toward their Jobs, and people who are 

^cow«vofei^s^ 

>lv 4 ]azt toward their job^ 

Such ^^^^^process is typically done by providing written transcripts of 
’ answeiX^^^^y questions and providing written instructions to coders 
mgarding bow to respondents based on their answers. To be sure that the 

coding instructions are undeistaitdablc and woikabla, it is customary to have two coders 
epeadcntly code the same re^onses and then assess the extent to which their coding 
As long as this percentage is above 80%, researcbers typically conclude that the 
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in&tructiaQC an afTective aad suitable for &>lt-acale imptemetitatioa. However, tKis S0% 
C jure is relatively'aibitmy-, some projects may proceed witb somewhat lower rates of 
anti otbos ituty rcquiTC hieber levels of a^reeaieiit before proceeding with 
:ll-scale coding. If aEreemetai rates are below 90%, ii ia oonsnOD for researcbers to have 
luhiple coders code all responses and negotiate out their disagreanents ailcr they have 
le all coding. But If agreaneoi rates ate above 90%, a siaglc codrr can be used 
dently m code cf^j^jj^rodeors aoswens;. 

THE BC-BS St^StailBER DEPOSlTtON SURVEY 


ey methods have been applied in the collection of data 
past experiences with cigarettes, perceptions and 

and the iinpact of the tobacco companies' conduct on 
:ed behavior. The sampling procedure implemented in ibis 
-BS Subacriber Deposition Survey,'' confonnod lo the 
sampling. 

pnbscribets of Ibar Blue Cross and/or Blue Shield plans 
dd of Louistana, Blue Crass Blue Shield of Michigan, and 
deposed as pan of the BC>BS Subscriber DepositioQ 
My focus in this report will be on depositions lalcen horn 
6 EBCBS subsenbets. In addition, 1 have examined 
Icpositioiis taken &om additional Blue Cross-Blue Shield subscribers deposed in 

an with the individual discovery in this case. I will be pcepared to offer opinions 
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about these deposttioru, which provide additional sopport for the cooelusioos offered 



h^oan. 

28. It is my uodcisteading that the court ordered 156 di^osilioiis be takenaf 

^^CBS subscribers who had smoksd 100 or more cigaiedes is their lifetime Qa additios 
to other dqxstitioiis tskeo ts well) To identi^ the 156 iadividiisls to be deposed, a 


s^unple of iadividuals^ 


awn using simple random samplmg procedurea Horn s 


Complete Ustiag of al^TOCBS subscribers who filed a claim during 1998. The sampled 


Ividuals were tbeslioe 


d by telephoDc by Audits & Surveys Worldwide to 


ine whether tfaet^ed^noked 100 or more cigarettca during their lives. I'eopla 


who were found to 1 


iriODS were: 


ced 100 or more cigarettes were hum contacted and 



In ortKr^ analyze the results of dw BC-BS Subscriber D^ositioti 


urvey, standatd < 


ctices ware implemented, with which I have extensive 


|e3tpcriencc. To beg^^^^oceas, I recruited a group of coders to road die traascripfs 
.and answer a set of^dSfidSw formulated for thepuiposa of dgtgr minrnj tbe pRi-h«^ 
^subscribes' aTWea^of^^ risks of smoking and the efiect of the tobacco oonqiaiues' 
lojoduci on fbw be^^or. Jhe coders -were graduate sad undergraduate smdeDB u The 


k Ohio State Univ 


re a great deal of confidence in the abilities of all these 


individuals and believe they were cagisble of perfonning the highest quality wndt for »*»»« 


project. 


30. As iii all coding projects of open-ended survey responses, ihqw coders 
'ere neither informed of the purpose of the study nor were they infomied of die results 


Cl ■d 2 t CiBPeS9«9 


16506 Q± CCE9 eS'dlT 


aMjxNti-!-i6e i-ansa ad wd 2v:n 1003 


http://legacy.library.ucsf.edu®di^ii)yqO^ap§//0'dtvw.industrydocuments.ucsf.edu/docs/ryhl0001 


52434 5602 


m 


JeiN 22 300 1 11:43 Pn PR DEUE 


Y BRLLRMUNe U.P.59 S333 To 9 0 29lg bS 59 4 37« I £ 

[I 


'loj scM nisti} ja ou lexp 

Ajamliepc Stximiojjstl swpauqcni iufpoo »t{j i»qj p^pnpaoo j ‘aiojsjsiyi,, unuBd ^ 
qsns JO RouapM on s«a asm ‘iotj tii inapocidsai jo oot^ssnb ninoujid Xna O) pan 
snxamaaiSwtp jptjj .»<p»ifAi««mRxa oi pataiumn aj»M sx»poo aqi *^i»aod3p monlrqiza 
30 Satsppioa m atBporuBci XltrindiUBd c jo nogsgi ^^^^^ tgaid Xpc|tuiwl v 
laipu 01 P90UJ ag pinoa sipocni auo g^pu. psq siapoa agi aasj ogj jogiaqA 

ajofdxd ej iapio 'aJOipjogx ■59»« 9g oi scomaop 3np<» liqenaii iixaisd oi SaipJOtaaJ 
ajmbai oogsanb oqi mn )»8Si« ppioM snn ‘awpo4^o<ft-<BBriMMg sjaatoasiSasip 
3q]jojaq(inui3Sjei«j(9 0|qBoo<lsaaa3aqprqtio,qS3nb.^^M3^dBji -gc 
'snopanjostn Soipoo aqi JO ssaoaApaogsa pov Xiobio aip papuiurMopjibptiB ‘spu isamaaiSs 
luoiporxa ns SCM.sn)x tuivid oapajiss aOAXatp moHiosp aqijomlats^^suo qipu,^ 

_'__ii ; 

poajSe pep Xsin isgi paisaAOj gonpu. ‘am o) njnsa/ apt ponpni 
Xap) xpfy -jaqio ipsa piUM. SnuiiXiie acususp) piop^/K.' 

Xlltwpoadspm (p-AN 9 Sl ' H ‘™»P!N-)P™B '- 02 -, 

"Q ’osoJSD iz,z:*AN9SI “I **00 Ul-AhOSl “M. 

!SI-AN95I “a "sspsw ilZ-AN9Sl "N ‘«*ld '-dl-. 

‘‘a :(»inp }aqi P aig>[KA.a nopisodap aq} Sopms /{moptiBi paiaaps; 

snopfsodap q { apoo tn p93|ss aioM Xaqj. -wt paas a j Oqi Xq^p^epMiuoj soopai 
pappiojd alt aiapoa 'caaooid Snpxia pjttpaste jo jxaiaoa aip m ‘XjjaatdXx sooi 

?tig>oa JO tas T pot ‘snoptsodap aip 3npiip pasn otqiqxa ai{) JO MS «'stduaanbC 
noppro^p 01 JO Jas» TO*® *>»* wopoo o«p‘Btaawd tnipoa aqiniaaq ox 'ic J 
Tuatp Xtd ppiM pnt Jtag} Snmotssiunnoa ecm inu/ui aqi tn And 
qomm pjoj JaASu 3 Lt»/o. saapoo »«p “P^J nj -sjJOm J«qj tnojg aSwiiia cn psTaacbu 5iaA\ iiqi 




il^ppgiaidaroa 
i|snT aip oj Sinpjoaai 
dmaH :z-AN9SIs 
SI ''a ’oK*il«0s«o= 
d Trend :9C-AN9S^ 




http://legacy.library.ucsf.ed Lfaid/iipjO^OQ/pdf fw.industrydocuments.ucsf.edu/docs/ryhl0001 



• I .-WJ. .w «. 


‘‘ V/'w *• t? 




33. la total, coders were ssked to aoswer 20 coding questions about eacb 
\dcponeat (the coding izutruclions and diese quesdooa appear tn Appendix B of this 

I 

report). When dte ooden eoaapleied thw coding, they submitted elecaniuc spinadsbeets 
me listing their answers for each deponent Aa integration of the ooding ^nradsheets 
xppon ia Appendix C of this leport. 

34. Tebi ts the coding remits for foe four questians foat gauged 

they loiew at the time they became regular cigarette 
.ts said they believed they did not tHiirlr smoking tnensasee a 

a serious disease, and 92% said they believed they did not 
"«their own chances of contractiiig a serious disease. 87% of 
ed they did not think they would become adfoeted to 
Joritiex, ofeoniae. suggesting that when these people began 
of foe principal risks of smoking. It is inteceEting to mte 
:ed a pattern that has been con&med in many otber 
^elow): they were more IDcely m believe that smoldng did not 
;ves (92%) than to othscs (77%) and more likely to believe 
e addicdtig for themselves (87%) than for others (42%). 
s the coding resulis for foe five quostioos ittat ^nged 
depooents' beliefi about what they knew at all times afUr they began to smoke eigatettes. 
84% said they believed they eventually came to believe that smoking causes serious 
disease for people in genetal; 63% said they bcLevcd they eventually came to believe that 
okiag inemsed their own perscoai chances of capcrieacing a serious disease. Again, 
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dc^aants were more likely to believe that smaking does not pace a health rick to 

tbemselvca (28%) than to others (11 %). CooaisteDl witfa these claims, 6S*/t of 

I 

g^spondeaCs said they believed they never knew the name of a specific carcinoeea in 
^bacco or cigarette smoke at any time when they amolc o d. 

, 36. 79% of deponents said they believed they eventually came to think that 


is addictive Ibrf 


, and 7d% sttid they believed they eventually came to 



that they ware ptfwnally addicted to smoicing. lateresangly, these figures barely 


ifest the expected 
pt that odiers wer 



peal symptoms in< 


on risks of s 



:e: people were appamnly only sli^itly mors wi&ing to 
br addiedoa (79%) than were they themselves (76%), 


ides many smokers widi first-hand, taird-to-refiitc 


iraddictioa. All die figuztss I just mentiooed in Table 2 


they are not lOLaniinoas majotides. Thus, between 16% 
lUeved that they never came to recognize the health or 
le they smoked. 


37. Table 3 i 


i SguFU regarding what deponexits behevod thc^ heard or 


I^eaid about statanent|af the tobacco companies. 93% said tbdy saver heard or heard 



lOtit a tobacco cos 


87% said 


in tobacco^ 


^ig that smolring increases die Ukclibood of serious disease. 


never heard a tobacco company name a specific 
e smoke. 37% of d^pooenta said they believed diay 


p ^ ar d or heard about tobacco company assertions that emoldng does not cause eerious 
and 43% said they believed they heard or heard about tobacco company 
Assertions that scieudiic evidence oa this issue is inconclusive. 
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38. 87% of zespondciiu said they believed they oever beard or bawd about 
y sutemeot by iny tobacco coEttpBtty that smoking is addictive- 12% said they 

lelicved they heatd or heard abouf a tobacco company asserting that smoking is not 
addictive, and 4% said they believed they heard or heard about a tobacco company 
asserting that the sciairific evidence on this issue is inconclusive. 

39. Thble^Mhows the coding nasults regarding depements’ beliefi about die 
effects tiaat ct^^omts by tobacco companies would have bad on them. 75% said 

believed that a ^b^^Jxnnpany statement that smoidnc causes disease would have 
ed them not to start to to quit sooner than they thd, or to try to quit. d2% 

said they believed com p a ny stateoient that smoking is addietivi; would 

to quit, to quit sooner than they did, or to try to quit 
ley believed that a tobacco company acknowlcdgetDeat of 
lOgeQ in tobacco or cigarme smoke woiud have led them not 
;UiT sooner than they did, or to ny to qniL Thua, rnqjoiities of 
ublic sratements by tobacco eeinpanies of whu they knew to 
would have reduced their rate of smokhtg. 

40. Ail c^^^^^dence is oaosistent with the assertions that most EBCBS 

^subscriben who ha4i;^S£qji^lked clauns in 1998 and whe were or had been dgaienu 
^smokers did not dangers of smoking when they began to smoke sad that 

sobstsmtial portions of these same sabscribers new believed that smoking was dangerous 
and addictive and did not believe that they were at risk for contracting a serious diaeuc ai 
the time they began smoking or became regular smokers. Furthermore, these results are 
istent with the conclusion that nicst HSC6S subscribexe who had been anokers and 
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had subminsd claims in 199S would hxve imokad less or would not have smoked at all if 
tohaeco companies h«d publicly acknowledged their belief In the existence of these 


41. The results of the BC-BS Subscriber Depositioii Survey can be 

^rtr^olatod to the population of EBCBS tnbscribcis who filed daitm in 1998 and had 



>een smokers, be 


: depoueata were randomly sampled fiom that populaQon. As 


■ lalTHMt above, flje ctror of each porcemage derived fiom the d^nents' 



#aponses is a maximj 


, meaning that the true pexeeotHse for fim populaiiaa has 


95% rtianceof falliM withm 5% of the observed petcootage in each case. The closer 


an observed pacenlai 


plins c txtft 


p%oi 100 % and fitefaifiier it is from 50%, the smaller this 
hefbte, some of the pcrccnbiges reviewed above have 


.9%. For example, the sampling error on the 93% percent 


of tespon^^^who v^^coded "no" on coding question 1 is±4%. 



A- Afsessu^^^ther Americans Accurately 

Undc^jfi^^e Cauanl Impact of CittareOe ffp 

42- I the results of a number of national surveys of 


scntabve sainpl 


of these studies w 


ublic^s beeldi. 


.erican aduhs conducted during the last fom decades. Some 


by eovecamcat agencies responsible for promoting the 


i were spoosoredby private orgaidzations dedicated to 


public health pnnuodon. And stTU other studies were sponsored by tobacco oompanies. 
^akna together, the results of these studies consistently indicate that portiom of the 
^American public (Le., any portion greater than 0%) have not fully recognized the health 
risks of cigarette smokiog. 
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43- I examined these survey based upon the fallowing tkw of b«Ue£s about 
health effects of smoldine. For a penoa to be accutatt In andemanriine the beslib 
posed by smokme. that person must (1) believe that smedcutg definitely iocccascs a 
l^eicao'B chance of oontraciiDg some specific diseases, sud: es heart disease, limg cancer, 
Ind/oi canphyseccu, CZ) accuratelyrecofniza the extent to which apenon'a edtaocea of 
boatracting these dis^^)» is i^reased by smoking, and (3) hold Oiese beUe& with 

erefbie, if a person ssya fius 8tnokiz)g 'migfat" uiczease a 
lung cancer, that would not be neeurnte, becanse smoking 
chances of comnctiiis lung cancer. 

ey was conducted fbr the Matianal Clearingbouac for 
'ling of 1970. In this survey, about 709( of lespondents 
ciearettea is hannfUl to health.* About 17K of respondents 
itement, and another 13^ of re^anuieot disagreed with the 



'“mildly a^^vith 





itatemeni or said they didn't )aiow whether they agreed or disagreed. Therefore, about 


^30% of respondents did 

45 

the Centers fbr Di 
a person who 
doesn’t saxsokc?* 




an accurate perception on dns issue, 
was conducted fbr the Office on Smoking and Health of 
1 in 198d. In this survey, lespondeats wete asked T>o you 
any more Hkely to get heart disease than a person who 

of le^oadeats said a jiaKiker ia more likdy than a nou- 
and about 21% of respondents said a smoker la not more likely or that drey didn’t 
Imow. Is comparable questions, 92Vt of respondents said the smoker was more likely 
dian the Dun-smoker to get Iimg cancer and about 8% of res^xxidents said no or don’t 
low. About 89% of respoodeuts said the smoker was moic likely than the non-smoker 
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to cet e<Bp}1yac>03^ and about 11 % amid no or don't iaiow. Tbus, 21 %, and 11% of 
. 4 -tiiaricana did not recognize these risks of sniakiag. 

46. In a 1993 srorvey done by the Callup Otgznizatiaa and sponsrsod by 
^nitfaKline Beodum, respondents were asked: 'IDoes cnriolcing cause or make these 
conditions worseT*, and respondents went then read a list of medical problems. Sd% of 
indents answcred^'^jfcs" lung cancer, 75% auswered "y**" for heart disease, deVu 
answered "yes" for cnpr^mcen, and 65% answered 'yes* fix* stroke: Thus, 16%, 25%, 
%, and 35% of ras^^^Sb^ respectively, failed to acfaoawledlge these health efiects of 

by the QaUup Organization done for dte American Lung 
asked; ''Wfaicb of the following health problems, if any. 
and respondents were then read a list of health problems. 
lyMj for lung cancer, 85% said "yEs' for emphysema, and 73% 
saase. Thus, 4%, 15%, and 27% of respondents, 
ledge thc 3 e health effects of smoking. 

eyi done by foe Qallu];i Oiganizahon. respondents were 
smoking is or is not hatzuflil to yotir health?" The 

g “is not" or "ttonl know" was 10% in 1977,10% in 
S, 6% in 1987, and 5% io 1989. In a related aoies of 
is which re^poodcots were asked “Do you thmk cig aict te smoking is hMrtnfiii or 
not?", 40% said "no" or "don't know" in 1949, 30% said that in 1954, 10% said that in 

I 

,1977, 9% said tbal in 1981, 4% said that in 1990, and S% said that in 1999 . 



6 % of 

d "ycs“ for cardio' 
i^pectively, faQed TO acl 
48. In a El 
ed, "Do you 
roportion of responi 
981, 8 % ta 1983.6‘ 
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49. Ia another serins of nirveyi by the Gallup Or g a n i z a ti oa. re^ondoats were 
asked, 'Do you (hiok that cigarette sniokiAg is or is not one of tfac ceases of long cancer?" 
The proportion of respondents nymg *j» not" or "don't know” was 59% in 1954,50% in 
1937. 56% in 1958, 50% in 1960, 30% in 1969,29% in 1971. 30% in 1972. 19% in 1977, 
17% is 1981. 6% in 1990, and 8% m 1999 (tliou^ the questiOB wording in 1999 was 
slightly difEenct: "^o you thirrk cigarette szookii^ is one of the causes of lung cancer, or 
not?'). The pr^wt^^^Tmpondous saying "ia not* or "don't know" in a comparable 
Question about hearf was 64% in 1957.66% in 1958, 66% in 1960, 40% in 1969. 

15% in 1990, and 20% in 1999 (thou^ the question wording 
slightly differenh "Do you think cigarette snokiiig is ana of 
). Regarding cancer of die Urroat, the proportton of 
^r’dont know" was2i%in 1977,19% in I98i, and 10%in 
1999 (d^^^tbe qu^^pn wording was slig^itiy different in 1999: ”How about caueer of 
the throat (do you d^^^^^tene smoidiig is one of the causes)?"). 

'ey done by ABC News and tfac Washington Rost, a national 
: "Do you think that a Imk between cigiuette sasoldng 
ilished convincingly or not?" 19% of reqxmdents said it 
i that they didn't know whether or not it had beeti established, 
on conducted a series of surveys for the Tobacco 
, 1976, and 19'78. In each of tboG* surveys, re^ramdeata 
were asked: ‘Tt’s been said that cigarette smokecs have mote of certain iUnesses than non- 
smokers. Would you ssy this is definitety ttue, probably true, possibly true, or not true? 
fo each of (he years, (be following proportians of respondents said the assertion was ‘Sot 


32% in 1977,26% m 1 
in 1957. 1990, and 
the causes of heart 
^ood^mying 
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or said duy didn’t ksow whether at not it wsJ true: 18%, 18%, 14%, 18%, and 
15%, respectively. 

52. Rcspoodents who answered definitely true, probably true^ or possibly troe 
were aslctsd a follow-up question: Ho you tbink cigarettes kfc a miyor cause of smokos 
topic of certain illnesses, or only one of many causes, or tbat cigarcaes are really 
It a cause of smoka^s^aving tootc illnesses?' In each of the years, the foUerwing 
4 that stnokiog was os! a cause of nnolteia’ increased 
and 3%, respective^. Ihus, these indivklaala also 
th risks of smoktog. 

these surveys yield a coosisreot pictnre. In foe 1950s and 
,ericans did not recognize foe health risks of cigarette 
.ecicans foiling to recognize these risks has been foiling 



hut very re c e nt svD>cys show foai the proportions of people 
ve not yet foilcu to zeio. 

of foe figures offered above arc likely to be 
ions of people who did not recognize these boalth risks of 
ly of the qnestions asked in foose surveys had a built-in 
propoitiDa of people a p p eali ng to hold accunte belicfo about 
^'ed^litetatara now documents what has come to be called 
acquiescence reepehse^^^' This is a teadancy of berween 10% and 20% of just about 
any sample of pec^Ie to agree with just about sny asseiticm presented in an agree/disagree 
question or a yes/no question (for a review of this literature, see Krosnick & Fabrigar. 

Many of foe qaeations described above involved sudi foimats, so foe 
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pcoponloQS of people ■who said "agree” or "yoa" prolrably overstated the proportions of 
people who actually held the beliefs that those re^wuses appeared to eacpress. In ail 
then, even more people failed to recognize certain wcU-established beahh 
streets of nookine than those survey studies suggest. 

35. There is an addidoaal reason why these surveys arc likely to undnrsiateQjo 
loponion of peopIt^^dAio^^ed to recofinizc the health consequences of amoildnE wclL 
ach tesearefa docti^fints that people typically see Sietnsdtnes Its less at risk for 

. . 

ricnetng usdesi lift cLfcnmstance than they believe other people are (We ms t ein . 





t^^wvey questions reviewed above ssked resp'^'l^tits abont 
pie's risk rather than theii own. Had these icspondeaots been 
•efi the chances that they personally would oqrerieoec 
more respondestts would probably have said "no* or 
>ut other people. 

AascsHitg Whedier Americans Accurately 
e Magnitude of the Caiital Impact of Cigarette 
iiallh_:_ 

56. Nonl^^^qucsdons asked in the surveys refeired to above is usefiil for 


quanti^drig the 
smoking. Wb nu 
Bocurate or 



itude of the lisk that people perceived to be assocsaied with 
turn to other evidence to assess wfaethcr Americans ate 
igipg how much a person’s risk of eauxaicncine sqious 


health problems is increased as a result of smoking cigarettes. 

57. One nuvey that has been used to assess people's perczptions of the 
magnitude of the health risk of smoking dgaietces was conducted by Audits A Surveys 
orldwide in S^tetnber, 19S5. A question in this survey asked: "Among 100 cigarette 
smokers, how many of them do you think ■will get hmg cancer because they smoke?" 
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Viscusi (199(2} inajje extensive use of this question in his book, giaolcing: Vtakinp tfaa 

RisVv periginn to asscu smokers' perception of the risk of smoking. VUcusi reported 

\ 

^hal the svecage probability reported by respondcots in this survey who reported « 
ptobabiliiy was 43M. 

^ 3&. Vueusi (1992) calculated whzt he considered to be the true percentaee of 



Dkcn who get Iv 
LUxIiy of hiss ca 


ifsnoken (e.g.. S2.9 


figure applying to the 


ibility oft 




due to sraoldag by dividing the number of people who die 
r to smoldns (e.g., 93,000 in the I980e) by the total number of 


iih 1985) and coaverting the result fiom zn anxuial figure to a 
^ of a smoker. This oalculation ^iproach yielded a 

]09i. on which Vlseusi (1992) focused throagboul his 


e rate of lung cancer deaths due to smoldiig. By 
average answer given by the Audits & Surveys 


ciscuai^&ludod that most people overestimate the risk of lung cancor due 



I tmrtMri|g, vastly ii 

59. Uafoi 


“^wording of the que 
^^cm. These probli 


Bch existing work, ^ 
LOMticaoa’ perc^tid 




, there are anomber of significant problems wifii the 
the analytic ^pxoaches taken to examining responses to 


die data considered by Viscusi (1992), as weU as oiher 


ling useful and valid moasnrements of the accuracy of 
: magnitude of the health risks caused by smoking. 


A MBW SURVEY ASSESSING WHETHER AMERICANS ACCURATELY 
UNDERSTOOD THE CAUSAL IMPACT OF CIGABJETTE SMOKING ON 
HEALTH 


60. In order to measure people's beliefs about the magnitude of the health 
risks of cigarette smoking in a more useful and inibiinative way, a new survey v^-as 
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comiuctwd by Scbulnun, Rouca. Buouvalas. Inc. <hereail«r SRBD under xny supavision. 

meajUTcaicnT approecb in this survey focused on foe standard messure of foe 

1 ' . . . . ' 

impact of • risk foctor oil the likelihood of a person acquiring a disease; relative 

^ult. Relative risk is the ratio of (he iacideoce rare of the disease among people exposed 
to^e tisk footer to the incidence rate of the disease omoitg people not exposed to the risk 
(e.g^ Maosner 1974). By writing and adoutiutering survey queatioas that 

^Sieht people^s rates of lung cancer among nan-smokers atid smolccrs 

(i^h a cleoity specifi^dtjsa^ of dgaronosX I obtauwd figures with which I could 
^^culate people's foe telative risk of lung cancer due to smoking, which 


could then be ooe 


■hedical data on the tnie relative risk. 


61. TheS: 



lonally 





|y involved random digit dialing (ROD) to interview a 
je of American adults. Interviewing was conducted 
October 2,2000 from SRBrs facility in New York City. 


62. The dothmlips^on procedures for the study are described in Appendix D. 


a^ the final table of dis^^^pns of the phone numhem ippeam in Appendix £. 

^ 63. prior ta^^^^nniagofthc interviewing, a quota was set such that at 

^ast a total of2,000 iqterview^ with current or former smokers would be conducted. 


3W answeiiits * 

id smolord 5 agaiettu^Am 


m-up questions, respondoiis were asked whether they 
> during the past 7 days ^Mopie who said "yes" were 


^assified as euttent smokers). Re^jondants who said "no" to this question were asked 

0 

whether they had smoked 100 cigarettes or more during thet entire lives (people who 



id yes were classified as "former smokers”). <t6% of the 4,473 people interviewed 
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identijEed ihonsolvcs sa cwtnest or former cmokctv end these individUAls conttmied «ith 
the iaterview. The remelning individuels were run asked any fiirtfaer quesdona. 

! 64. The questiomialie used for the surrey appeals in Appendix F of this 


report. 


65. When a telephone ouvey sample is £«&en(ted vis Random Digit Dialing 
and a sin^e responds^ ftoin each ooataeted household is selected to be interviewed, it is 


□ecessaiy to wai^tt^KObUiacd data by the nomber of woildQS voice telcphCMie lines in 


he household and i 


■ of adults living in (be household in order to yidd figures 



that are geoetalizahre to t^nalional populatioa This was done for all analyses reported 
below. 


66. Ami 



asked of the cutreot and former smokers were foe 


rd turn to a difFcrcnt topic: what you ogaonallv think about the 


effect of cie 


[lOldnf on people's health. Fm going ic read these next two 


questions ^ think about each put of them, and 1 can repeat 

each quQrtic^^flai^y times as you IDtc before you answer, so yon can be «rc 

^OWVAW.VvKv 

they arc tle^ to yoA First, if wc wrre to midomly choose one thousand 


As^ricaa never smoked cigarettes at all diirizig their lives, how many 


of those 0 (fo 



people do you think would get lung cancer somotbne 


during their Itvce?* 


"And if we were to nndoiiily choose one thousand American adults who each 
anoked one pack of cigarettes a day every day for 20 years starting when foey 
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were 20 years olil, how many ot those oae tbousajod people do you think would 
set lung eucer sometHne dormg theti lives?" 

67. The distributions of enswera to these two questions eppear in Table 5, and 
at the bottom of (be columns are the mean and mediui values for the col mrinfi and the 
number of rm^oiidcnts who provided answnets to each (fuestion. As the last colmnn 
shows, the average p^au^ grop t Of 1,000 20-year pack-a-day stnokeia that le^pondenxs 
ugbt would get lu^^Sancr^ was 433.5, or about 43K, and the median value was 500, 
^ 50%. As tbe prior^dip^shows, the average number out of 1,000 non-amedoers that 
odenta thought would^^ lung cancer was 188.2, or about 19%, and the median 
me was 100. or 

e people’s perceptions of the increase in the risk of getting 
perceptions of relative risk were calculated by dividing 
to Qie question about 1,000 smokers by his or her answer to the 
Because this quantity is undefined for respondents 
i-smokexs would get lung eancer Cbccause the denominator 
these people would be zero, and division by zero is 



jestion about 1,000^ 
Iwho said none of the I,' 
fof the relative risk 





impossible). 1 was a^^^^^ese respondents’ answers to the question about non- 
okers to allow thc^j^ti^risk quantity to be defined for all icspondents. 

69. The obsffllnididisttibntiaa of nelanve risk figures for the sample appean in 
Table 6, Down the left side of tba table are vaiicnis ranges of relative dsk. The middle 
column of the Ubic sh(rws the percentage of lea^mndaits whose perccivod relative risks 
eU in die range shewn on the left side. Thus, 5 7% of respondents perceived a relative 
oflessfitan I, meaning that they thought smokers developed lung cancer less often 
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than non-smolcers. ll.« 5 %ofJhciainj>lepereeivcdar«Uiiveriilcef 1.0,inc«iimgthat 

“^cy thoagtu smokers and non-soiokers wrre equally Ukdy Ui develop lung cancer. 

7.3% ofpeoptepeiccived ft relative risk between 1-01 and 1-99, and ie. 0 % of people 
eiceived ft relative riftlc between 2. QO and 2.99. 

70. tbesecstinMtes can be conapsued to the figstes that appear in the 19S9 
;eon Geoeiftl'a istficaie &at &e rdstive of death due to lung eattocr 

or one-paok^-day t^^era as eompaied. to son-stnoken is about 13. Other published 

T many smoken as gieater than 13. This figure can be 
Alive risk of ftfttting lung cftncer if we assume that almost 
lung cancer dies of it. 

of Table 6 shows the cunnilatdve percentage of 
relative risk lasge or in one of the ranges listed above it in 
indicates that 80.6%of the samp la perceived a relative 
tmyoxity of respondents peredved the relafive li^ of 
:o stnoktog to be less ttun the actual telative risk. Indeed. 
50% of the respond^Tcou^ be said to have vastty naderesttmated this relative risk, 

about 0.6% of respondents estimated the relative risk 
in die 1989 Suigeon Geneial‘s report), and 18.6% of 
CiQCcrduc to stDohdfl^ 



believing it is less 
about right (based 
respondents overesi 




72. These results dearly suppott the conclusion that the vest rnqority of 
Americao current and fc cmer smokets cutteotly undaresthtute The inersase in risk of 
getfing lung cancer due to smoldng. Thus, even after extensive natioEid publicity about 
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4ie bcaltb risks of smokiii^ most cumeot an<l foraxer smokets appea r to believe that the 





bi^crsase in risk of gctiinf lunx cincer due to ats^riuj; is much less than it txul> is. 

73. The focus of this ajisiysis has been people's perceptions of the relative risk 

Cettiag hiox cancer dac to snoldxts- As some of the surveys reviewed aliove indicate, 
ijinx cancer is one of the best-known health risks of tmofcuiB; if not the single best 

. Consequent^^kraCTcsss Were less likely to anderaiisiaie foe relative risk of 
hng cancer than to ondexestimate the relative ride of ofoar diseases that are 

^ fr 

n> be caused This means that if the two 5RB1 survey quesdoos had 

about heart disw^^o^ caacers, or stroke h**"!^*! of tuof cancer, tlw prevoleece of 
uoderesiimatioa of would have bees eves greater than I observed for lung 

^Pie-€i^^l^^tudies Assesang Wbefocr Beliels About the Health 
iComytaences of CiFarette Smoking I n fl ueoce Smoldng Onset or Quitfeia 

ice Uteraturs oifotB a number of studies that can be used to 

er beliefs about the health consequences of cigarette 

set or quitting- That ia, of mteiesl here is whether 

risky enhaiws the chances that a non-smoker will begin to 

W.oker will quit emoking. If some non-snudeen began to 

e they underestimated the health, amsoqnoices of ssabking, 

health consequences ntore aecaraie would have decreased 

e likelihood that they would have begun to smoke. And if some smoketE frjtH to 

I attempt to quit because they underestimsted the health consequences of smoking, then 

their beltefc about health conseqneoces more accurate would have increased the 

likelihood that they would have quit or tried to quit. 
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Ibutid that amolcfn pcroeivvd the health conaequenees ofcmoldoc to bo loss untlesirsble 
.on did aon^smokers. Thus, ii appears thai smoloecs cope with their cognitive diaaonmee 
lees) partly by this mectuniism. Chough they may also soategically downplay dteir 
eroeptiotts of tikdiboad of undesirable beallh consequences fhliowing from 
smoldng. 

t^bether or how smokers cope wjih dteir cognitive 
onance, it is slso {^^ble ^a( pr«-existiiig differences between smokos end oon- 

dU^hc health consequeotxa of smoking may partly deteixnioe 
subsequently become smoken or not In order to test 
to collect data from a gnHjp of non-smokera repeatedly 
leir belieC) about the healdi effects of sinoldng, and then 
predict who later becomes a anolcer- In fact some 
and have found that people who initially bdieved 
pact on health were subaequenlly more lilrely to become 
1984; Cbassin. Pressoo, Fins, & Shennan, 2000; 
hassin, PieSSon, Sh^rmuT^ Edwards, 1991; ct, CoUins et «1^ 1987), This is 

dciod very stroi^j^d^ee of causal impact of one &ctor od asotber (Finkel, 199S; 

79. 19B2,1987,1998) has dooB imd catalogued a great deal 

bf reseaicb showing that people typically believe that they ere less at nsk personally of 
pitpcrieuciiig on undesirable life circumstance than are other people. This highly robust 
.ding makes clear the onponanca of recognizing the distinctio]) between people’s 
efs about the health 7i.sks of smoking to people in gowial (which we have considered 



29 

d 2lnc6PSS9aaisZ06 Cl CCC3 SS'dTl SNliNbinyej 


Aan3C fed ,Jc ^■7 ■ I 


I00Z no: 


http://legacy.library.ucsf.ed iSlid/uyqOZaOO/pyGW'w.industrydocuments.ucsf.edu/docs/ryhl0001 


52434 5621 






^ f rAA L Cm 


I BEST 
I COPY 


thof far) aod <li<nr bclic& about the health risks of smoldnE for tfaemstives peisoiUkUy. iQ 
prioetple. BBOfcm tnsy be less likely than non'smokers to acImorwle<lge the boalth e fferrt 


^^^^^stsoldng on others, bat cmokeit and nou-smokerB may be equivalent in pocdvijig tiie 
^ in|>a£t of smakang on their own penonal beahfa. But a series of studies contradict this 


on: Bcnthia, Slovk, and Scvcncs (1^93), McCoy et »L (1992), Gcanbaug and Kangon 
179). HaoscA and Mldqtte (1986), Leventhal et aL (1987). Mars^iall (1990), Murray « 




i (1984), and Vogili, Oi««a. and Severson (1991) ibuad 
i beUeve Otat smnlditg would cause undesirable hwith 


£br them peisoxtaj^ thaji were noo-smokecs. Hi^c findings are therefore 


(1994). Uiberg and | 
I smokers were less! 



cboaisteot with the nod 


tiese personalized bealdi beUc& partly detetmiae wmoifing 




evidence comes from studies that asked non- 


|oke. In studies by Levin (1971) and Kahn and Edwanla 



'70). the moot freqi£tl^^^^ea reason was to ovoid the undesirable health effects of 


This. too. isc^^Aent with the claim that perceptions of the heolffi efliocts of 
'^^^ooldng ore impoitan^CKnisinaiits of wfaeiticr a penon docs or does not smoko. 

81. Yet an 9 tli«rfiMinst»f***“'^ce here involves the streogtb of people's 

^^^lieft about die of smoldng. Even if a person is con^letdy coovincad that 

^^^paokinfi cubnantiaUy^^^^^ his or her risk of experiencing bealib problems, ffiu 
may have no impan on his other smoking behavior if he or she attaches so 
m personal iiup or ta nee to those health effects (sec, e.g-. Petty & Kjosnick, 1995). 


Sereforc. attaching greater inqxntaace to health eOcctc of smoking, coupled with the 


%. ¥ 

that smokinc is deleterious, sboald lend to less smokmg. Consistent with this 
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logic, Menlin (1973) repotted <bal people tvlio attached more unponacce to the oBocU of 
cinokiag oq health tme indeed less likely to smoke. 

82. One very robust Unding at first appears to challenge the general 
conclusion that beliefs about the health effects of smokinf arc partial causes of tmoloDg 
icvior. Gexnrd ec al. (1 996), Harrison e( al. (1996), Lee (1989), McKcosa ct el. 

1993), McMaster aft^ Loe (1991), Perrin and Yatko (1965). Strecher ec aL (1995). 

(1966), (1987), and WiUiaou and Clazke (1997) (bund that smofcets 

'ere more likely tb^.^o^%isbkeis to that they tbemselvos would get a aasolehig- 

ifetinies. Likewise. Hiud and McGarry (1995) and 
JSat smoken were less likely to believe they would live lo 
ikeis said of therasdvas. And Greening and DoUinger 
said “a person like them'' w» more likely to die of caocer, 
did Dofl-anokers. At £t3t glance, these results seem to 
ted previously, showing that siuoken think (he health risks of 
)kes do. 

Lt to recognize that the quesiioos Used to measure belieik 
about likelihood ofexpenocing iUnesses and life expectancy in these studies did not 
mention cigarettes That is, these qaestions did not measure people’s 

pccceptioQs of the Emoldng on their own health or likelihood of death. And it 

turns out that smokers do hot in fitet see theinselvM to b< more likely to escperieoce 
smoklng-relatad diseases uaiauelv . Inctcad, smokers perceive Ihemselves to he mote 
likely than aoiKSixioIccn perceive themselves to experieaoe a wide range of undesirable 
condiu'ona. including oues clearly imrelatad to smokjog. For example. 
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Swui«hsrt (19££) fbiuvl Mnokerc Slid they were more likely then did noo-anakets to 

get the flu. Harrison et al. (199<5) fowid that smokers said they wm more likely to 1»ve 
^ an accident^ or develop arthritis than non-smokers said of themselves. And McXenim et 
al. (1993) found Qiat smokers woe more likely than Bon-onokers to say they would get 
^ arthrids, be com e sterile, get veaereal disease, and develop citxfaosia of (he livxr. 

84. It these peroeptions arc grounded in observable real-life 

events and genctal plk fiaetbn. For example:, soiakers report banring had mote jreceot 

visits to doctors, more ehionie bealdi conditions, and mote 
do non-smoken (Halpem &. Warner, 1994). And 
as having hisher levels of risk factors other than sntoldng. 
(1991) found that smokers repodod experiencing more 
Thus, although the rales at which smokers report 
and expect to cxpteneoce healtb problems exceed Ok rates 
is not confined to smckldng-relaied health problems, 
leseaich is consistent with the geaatnl claim that beliefs 
of amoldng are important isstisators of efforts to quit 
smeking. For exai^^^^^ois, Famw, and Miser (1995) fbund that 72% of a sample of 
cuireat cigarette r e p o t ted attempting to qnit smoking at least once 

previously, and ttu^^^gg^vec most often for hying to quit was to avoid the imdeeursble 
hetdth consequences of smeddng. Likewise, Ahtuwalia et al. (1998), Crowe et aL (1994), 
Dappeo et aL (1996), P i i nran et al. (1992), Maaga et al. (1993), Halpem and Warner 
^ (1993), Lichtenstein and Cohen (1990), Schneider (1 9SA'), and Swensoo and Daltoa 

1983) reponod fiul the leason ex-emoken gave most often for quitting or waatiog to quit 
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wjLA improved physical vid loas^vity. And Stotie ttod KjisLcllcr (1^^) fb^lnci fh x t 
^th« deleterious health effects of nii<ddiig were die most eazamonty given reason by 
I fbr wanting to quit tmolang. 

86. Consistenl -with thsi evidence, Cuny et al (1990) found that people who 
.were motivatcxl to quit fbr beattb reasons had a greater desiie to quit flutn people 


iTKitiyated by other 
modvattd by heali 

I 

^Qempt to qtrit 

i that people who betij 

! 

subsequently more 
: Sherman, 1984). 




ae supce 

found that among ] 
uiidally believed moi^ 


Boiiaad (1997a) found that people who were more 
were more likely to intend to quit and were more Hkaly to 
And Rose ct aL (1996) and Klesges et al. (1988b) fomd 
'le in delemdoos health consequeocea of smoking were 

to quit (c.C, Ahluwalia et al„ 1998; Chaaaio, Pieason, 


,t with the notion diat beliafi about health consequenocs 
oj^qniaine attempts, Tiptoo (1988) and Kanfeit et al. (1986) 
participated in a smold&g cessation program, those who 
gly that smoldng causes health pioblems were most likety to 


^ be tuccessfill in qv^mg smoking (cX, Klasges et ah 1988b). And a number of studies 
found that pecple who trigi to quit smoking for health raasons were subseqaently more 



le edio tried to quit fbr odier reasons (Borland, 1997a; Curry 
1992; Halpcm & Warner, 1993; c.f. Rose, Chassiii. Ficsaon, St 



likely to succeed 
etal, 1990; 

Shetmaa, 1996). 

88. If beliefs about the health risks of smoiosg are indeed causes of amokipg 
onset and quitling. then we riiould observe in the SRBl survey data the same rclatiou 
anted in die dozens of stndies reviewed above: cuiiaui smokers should perceive 
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less risk of smokins tiuo do cunvat usa-smokois. Tli^ SRBI survey Sample iacluded 
both cumsot and fonaer smokers, so I could test this hypothesis by assessing whether the 
flatter individuals manifested higher perceived relative risk than did the fonoer 
< mdividoals. And in £Kt, the mediaa relative risk percedved by current fbnnar smokets 

I 

was twice the median relative risk perceived by cuaenc smokers (d.OO va. 2.00; 


j difioence: Mann-Vftutiicy y^71895, p<001, N=“1903). This finding not only 



reinforces coofidei 
Reliefs but also rei: 
i pooeived idatzvci 


89. The 



; ifbdiehl 


like claim that smoking onset and quitting aic affected by health 


idokce in the validity of the SRBI survey's meaunre of 


ey data also permit testing nziother notion that should be 


[Uences are causes of quitting behavior people who 



. petceivl 


L quitting attempts^ 




of lung cancer from smoking chould ncgict cm raving more 
sd to quit smoldsg (beliefs that are presumably instigaion of 
II survey penoits testing this idea because all re^roodeata 


were asked two pain^^p^^oDs measuring i^et regarding smoking, and respondents 


who said they ^ 
to quit 


' smokos were asked additional quesiioiis about their desire 


Bsast *1 


you not r 


^ at all that you had navegr started to smoke cigaienes, or do 

I 

^ all?*' (IF DO WISH:] How much do you regret having 


started to smoke cigarettes? A great deal, quite a bit. somewhat, or a little?’’ 
ITnhimnv- "Whca you think sbout baviag smoked cigarettes in the past, does that 
make you fee] unhappy «t all, or does it not make you feci nahippy?"* pDF 
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DOES:] "How uniuppy docs that make you feet? Extremely unhappy, very 
conierwhat vmhappy, or slightly unhappy?"* 

I-ike to ^lop . "Would yoti like to stop smoking cigarettes, or v^ould you not like 
to stop smokiag dgarettc*?"’ [IF WOUUJ;] "How much wonJd you IQoe to stop 
grrytiHr^g cigirettss? A gtoot deal, quite s bit, somevdiai, or e litller* 
r ikeithoo d ilPuyin^to guit . "How Ukely is it that you will try to quit souAiiig 
during Ae months? Definitely will tty, probably will By, may or nuy not 
t*y. probabl ^^Tj^ tty, or definitely wjU not By?"’ 

90. Ansu^tojacb of the first three pairs of questions were combioed to 
yield three 5-point \ |.g., Sa?egret a great (teal, 4=regp8t quite a bit, 3 ‘ *t^ g tvc 

I and I ^ot regret at all). Tbc £rur resulting 5-point Scales 
to quit were correlated as expected with peie^ved relative 
<.pOI,N=lM7). r=.12 (p<O01, N“18S4), r-=.l8 (p<.001, 

N-942), respectively, Ibr Regret. Unhappy, Like to stop, and 



N*938), end t«-.l23 


1 . ik eli h ood of trying These ooirelations meair that people who perceived t 


higherielafive ris 




^cancer from smoking were more likely to regret having 


smoked and were to want to quit and to intead to by to quit in the pear fiihire. 

91. Tal^^P^ber, these various sorts of past studies oUer a strong array of 
e mptriral support diat beliefr about health cooscqueoces are causes of 

cigarette smoldng onset and qmttiag. Believing that smolang is less damaglTjg m health 
allows a person to begin smoking more readily, and believing that smokisg is mere 
dama g in g to health inspires people to try to quit smokin g and to succeed in quitting. 
iTherefote, if Amencans were led to recognize ihai the health coosequeacas of smoking 
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■re more <liua>ciAS tHey bsve been or vert not lod to believe that [he ScieDbfic 
^evidence od the health eSTects of sipolaiis was incoodnsive, (his would most likely have 
^ed to 8 roditetioa in cmoldae behavior. 

F 

, C. Certainty of Beliaft Abr ^'* EflEfects on Health 

' 92. A great de«] of leseaich m psycbolojiy Shews that the more coohdeot 

people are tn ■ perti^ulv belief they bold, the more impact that bdieflias on their 
%unkmg.sad action ^wPeOy & Krosniek, 1995). So, for example, the more confident a 
person is that daily prolong Ufe, the more likely be or ahe is to perfimi daily 

^exercise Ofiresumio&jof ooufse, that be or she vahies proloogod life). Thifir»f6ie> among 
'people who believe H j gj^ ^ ggreffe smoldng eausea adverse bealth efiects, die mote 
pnfideol these indi^l^il^^iie in the accuracy of fiiat belief die less likely they arc to 
smoke. I^l^ihcrefolll^iii^g^trtst to know how confident the Americans who believe that 
smokmiicausbs advf£$^healdi effects are in this belief If large numbers are not 
maxiinally confider^^jd^ t^auM mean they sienot fully convinced of that assCKtioa and 
that increased certainty^^^uld most likely tednee smoking rates among these individuals 
(by inspiring quittii^Wllfihlbitmfi onset). 

93. The ^RBI Slavey afforded an opportunity to escplore this issuer it inclnded 
^ questions that ao which I am aware included. Respondents who said that 

i the 1,000 smokers ^ 


i lDoely than the 1,000 non-smokers to get lung cancer were 
, then asked: “Yoa said that the smokeia are more likely to get Itms cancer than non- 
smokers. How certain are yoo about that? Extremely certain, very certain, somewhat 
certain, slightly certain, or not certain at aUl"’ 
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9A. Of the respo&dwits askad ihi< question, only 29.8% £21(1 they were 
^ qjrtremely certam; 29.1 % said very ceruio, 25.5% uid somewbat eettsin, 7.2% said 
cenain, 8.2Vo said not certain at all, and 0.3% said "don’t know” or refused to 
P at^swerihc certainty question. Tl 3 ittS,aiii^otityafthet«spnndemswholieUrvedtfaat 
^ siUokBis are more likely rhim non.^smokers to get luxrg cancer were not maximaUy cenain 
that. Aji iTirrett^m ftoitnipty 4n rtisi heHaf i» fherefora possihle fbr moat of these 
individuals and woul^^Mdllfcsly increase the impact of that belief on their smokitig 


li^faavior. 


D. Wotild^^^l^^tatcaDeatt by Tobacco Coinpamos Have Changed 

the HealfliKste of Sniol6ptLCiwrettes2- 

95. Thus reviewed evidence Indicating that people tiadeiesl 


ths^ealth Tisks ofsmi 



dversc health efiec) 


: between ano is 


^ reviewed evidence indicating that people uaderestimatc 
|d that beliefi about the health efTects of smoking are causes 
f. The next evidence I reviewed addresses the question of 
I had stated publicly that they beUeved smoking causes 
i notmisrapreseoted their knowledge concenung the ciusal 
^ous adverse health consequences, these staiementa and 


^^^missions would havla'inenaaBed the public’s belief in those health effects and therdty 


luced smoking in 1 
96. One s 


i by any i 


i public. 

« cccsiateBt with this latter claim is evidence that public 
e Of otganlaation or axpert on smoking afbetstfae 


public's belief in that assertion and reduces smoking. In a series of time-series studies, 
garner (1977, 1981,1989; Warner & Murt, 1982) has shewn that releases of the Surgeon 
General's reports on smoking sod health reduced dgziene consumpticn lathe Unitod 
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States, as did televised ami-smoking adveituemcnts caxryisg the suae message firotn the 
federal govenua^ to the American public. 

J 97 However, Americans vrere apparently not fully convinced of the bealtti 
effect claims made by the Surgeon General, as documented by the survey evidence 
KTviewed above. One likely reason fbr this is suggested by Swineharl's (1966) reseaich. 
measured peopl^^t^ixnons about smolcmg and health on dme oocaaioru, 2 vvedcs, 1 


i^ntb, and 3 montiu tha Surgeon Oeoetal's Advisory Committee's 1964 report on 
^atoidog and Health Over these thme measurements, respondents aoqymased 

^creasing skepticism'bias of the authors and the quality of the evidence they 


mted. Iliis suggests 1 


t was not considered maximally credible and was 


it^fore not fully pc 
^ade by con 



public's health, the p ubliO 


30 its own and in the oodiext of other pmblic staieroetns 
^thetime. If other people or oeganizatious had made 


about the impact of smtAmg on disease, and these other 


^^ ereeived as ovedy concerned and alamiist about the 
mghl have become more oonvinced thae they were of tbig 


98. A gzcatde^^ research ou penuaaian by social psychologistt indicates 


tobacco comptoife 


seasage. This is be 


I have been especially persuasive sources of such b 

pie often judge the credibility or bclievsbOity of atnessage 


^osed upon Che possible mou ves of the source of the message. One possible motivation 
for uttering a message is (he genuine veracity of the claims tnada in the message. But 
^lessaga lectpicnts recognize (hat sources can sometimes nuke inscenrate statements 
®?^ause of a pursuit of malerisl self-interest, which occurs when acceptance of a 


'p-d 2tB^6Pes3P9t620S Oi CCC9 BS-dll 3NJiNa*n«a A3n3a -dd u 


d as:1! 1002 23 Nbf 


http://legacy.library.ucsf.ed ffi'dicl/afqQ^pQO/pdfvv.industrydocuments.ucsf.edu/docs/ryhl0001 


52434 5630 




- o J O r ^ U i y 4 ^ 


r AA C i B LIL g H 




message’s claln by an audieoce will »mh»nr.«; the wdl-beiag of the source (for exjusple, 
as in B television 'advertisement paid for by BsIiob Bnteis in which the CEO of Hilton 
[oieU Bsserts that theirs are the best hotels in the worid). When a source mighi have 
|uch an obvious ulterior motive for maidog an ssceitioD, people are skeptical of it and 
less likely to be pereoBded by the incssa^. Box when » source's message undormincs his 



in whaa tire CEO of {£ltoo Hotels asserts that Westm 
in the 'wntld), »mtieooe meniben arc eq^cially UksJy to believe 
ed 1 ^ it (Eagly A 1975 ; Eagly. Chaiken, A 




IT her material self- 
otcls are the best 
assertion sad to p 

^''ood, 1981 ; Eagdy, Chailcen, 1978 ; 'Walster, Amnson, dt Abrahams, 1966 ). 

99 . Tf tnb feaalMiAn anics had issued public ataiementa begmaieg in the 19305 

1960 a tbereju^^Siilihey b^eved cigarette amokiiig caus es serious diseases or 

they withpSS^^^c health authoiitieE' cemchisioas, doing so would clearly 

pst ih^^^teiia] self'iotercsts. Ttmibre; these messages would most 
especially credible. This credibility means that such 
emants by tobacco ^^poics would have been espedally hkely to produce belief 
vchange in the Ameri<^pu 6 ^c. 

IDQ. In attempted to teat acjentifically whether simultarteous 

lOsure to staleme:^^^^^ Surgeon General and tobacco companies that srooicing 
h!»a««a incre^^^^Brs* regret about nnoldng and datiie to quit smoking today, 
s proved lo be tnie. it would reinforce confideonc that this would have happened in 
the past as well. 

101 . To accomplish this taet, the SRBI survQ^ included an experiment. This 
lerimenl was designed to simulate difTereot information environments and explore the 
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impact that dififetoit messagec bava on amoken' rosnt about sttmldng and de^e to quit 
Tfae survey meastued re^ondcnts' relict about a m ol riiig and desire to quit, and this 

V 

Imeasuromezit ivas prooeded for some icspoodcnis by CKpoauze to stxtemeatt abom the 
beaith effeca of smoldiig. Using the resulting data, I asessed whether diis raqwsurc 

changed re^toodiana' levcb ofrtgrest and desire to quiL 

102 . The SRfil survey respondents were each xandomly assigned to Qoe of four 
' "contror groiQ), the “SG" gtovp (for Surgeon OeaexalX the 


groups, which I 

TB” group (for To^KbwpiJnd tea 'SGTB" gronp (for Soigaon Genend and Tobacco). 
Prior to being askec^^^l questions labeled above as j^eerot. Unhappy. Peairttoonit 
and Likelihood of puit Cwhich I will call tneaserBs of Motivation to Otatl . 

SGTB groups were asked ■ seiias of iecogniiian 
orjint they had heaid or read a variety of ststcemeDCs made 
cfTects of stuoldng. In this way, these taspondeiits wtgre 
The respondents lathe control group ware not asked any 
y were exposed to no new mfomutuni prior to the 
to Qmt. 

q^Stion quesUoiu asked of tihe SO laspondeuts wens: 

yon soma statBmenta and ask whathcr yon probably heard 
today or probably did ant bear or read ea^ one. Tbehnt 
tinted on some packages of cigarettes. It says: QUOTE 
cancer, heart disease, enqihysema, end may complicata 
QTB Do you think you pxbb^ly did hear or read ftat 
stateoieat berfere tc>day, or do you think you probably did pot hear or read it?" 

"The next cutemeot was rude in 1979 by the Surgeon Geneial of die United 
States, whose job in the federal govemraent is to protect and advance the health of 
aO Americans. He said; QUOTE Cigarette amok^g is causally related to hog 
cancer is both men and women. The risk of developing lung cancer is incraased 
with mcreasing dosages of smoking. END QUOTE Do you think you probably 
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106. Mmy AiaencAns pnibably mcposed to 010 Philip Motrio 

odvemsorQCBts mSntioned in the second (Uleaaeal aad the fioel qoatc fiotn the CEO of 

\ 

^^rowc sud WitlialBsaiu became th*y appeared in many new^apem ac 208 S tbiS country 

C ST in a wire service stoty covering testunODy given in a tobacco-related trial is 

And cinolcei:) are genetaOy tnoee iowrested is info n aa t io n about the health risks 
EmoloDS than are ^on-smoker* (e.g.. Feather, 1962.1963), so the SRHI survey 
^eoioodoats (all i ^ n fe ji^^^Mtoer smofcRS} vvere picbabty <s^>ecia% attEutive to these 


^^Botes when they 


newspapers, these people's shility to remeseber 


jdicoe statemeois lai^^K^^ereiinc not surprising that large pir^rtioDs of the IB 


group lesponde&ts! 
^*ey probably heart 
> read theJUKtetaicc 


they had probably 1 


^lad probably heard or read those sriuemeote. 86.89s said 
Uhe cecood statement, and 63.1% said they probably heard or 


|>iiring is the fba that 64.4% of ro^ioadcDts said they tbougfai 
r^^ead the first quote, which appeared in a ooofideatial tobacco 


conqMiQr doewment i^^beUeve has not received widespread publicity. However, 
perh^s due to pub^^^ofh tobacco company enqiloyee's belief ia the health afiects of 


imoldng in the moVie, Th^ 


, as wall as other recent publicity of tobacco litigation. 


many respondenis | 
made by a tobaccer 


^ recalled bearing or reading about such a statemant being 
any employee. 


108. Note that the three quotes that the TB group beard say eacaedy the same 
things as the three quotes that the SG group bears. For both groups, two of the quotes 
they heard said that smoking causes lung cancer, and the third quote said that aoaoking 
Icauses loos cancer, heart disease, and emphyEema, among other diseases. Thus, other 
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Uun wording cbagcs, the SG snd TB gioups heard ecsenUilly the same messages 
pCr«(od by two difTcrent eources: The Suigcoa General and tobacco con^ades, 

109. Respondent* in the SGTB gnnqi were asked six leoognjdon quesdoas, the 
that wore asked of the SG group. foUowcdby the three that were asked ofdieTB 
. The igu p ua t i oasoftbeSGTB group who laid they probably heard or read these 
were lelativ^y stmiUor to those {soportLons in the SG and ili groups (91.0%, 
3.9%, 64.1% 49J:»^?8^^. 54.6%respectively). 

110- Becai:^ei^sp^adest9 were randomly assigned to the oontiol, SG:, xJb, and 
OTB grovqift, dieir demo^pphic chaiactenatics should be extremely omilac on average, 

le, the proportions of the tour giQiqrs wbo were 
and 85% lespectiv^y. The proportions of the groups 
school were 59%. 51% 51%. 54% respectively. The 


bad bottsefsoid incomes between £31,000 annually and 

tO.OOO annually ’ ^ 11%. 12% end 10% respectively. 

111. Xikewisi^'4^ four groups were erdemely similar in terms of two ^thioiis 

.e interview in answer to these two questions: 

'Lefs begin^with so|ie genenl questions. First, bow would you describe the 
quality of tliai most Amencaos receive these days: EtecUent, very 

good. goDd,|[air, or poor?" 



“And howl 
healtoa 
poor?" 


! yc^ describe the job Freeidant Clinton bas done in boodling 
(his presidency: Excelleal, very good, good, or 



The pRg>oitions of the four groups of respondents wfan raxed toe quality of Americeo 
henltocan; as “good" were 31%, 31%, 33%, and 32% respectively. Likewise; the 

iportions of toe g^roups who rated President Clintou's handling of health care as “good* 
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■were 23%, 27%, 26%. aad 24%, respectively. Thws, it ofipeus that tbe randooi 
assigomeat procedure yielded four groups that ware quite eqoivatot 
^ lt2. My purpose m varying tbe rccogttiiton qnestioiis that preceded tbc 

Mottvadoa to Quit measures sras to explore the effect that bearing those statenjeots 
Would have on people's motivatioa to quit. I expected that exposcre to the Surgeon 
Geaeral's qaates al^e would notpio'vide any novel infonsatiaiii to respoadenQ, so the 


? level of MotiVBtiaalSPQtatT 


I by SG group reapondoits would be coopanble to 


it of respoodeats^jtae petrol conditicKi. To test (his idea, l avenged dw fiiui 



measures of Motivl^u^^uit to yield a single index tod tested whether respondents in 



the control group I 
dte SO group (3.1J 



.1 level of MotivaiioQ to Quit than did the respondents in 


S, respectively, on a scale fiom I, meanins highest Motivation 


Modvatioo Co Qint). These tvro groups' means were run 


signifii^P^difrcr^ji^^m one another (p=.24), ccoaistent with toy expectation. 


Therefore, these two^^^ps were combined for subsequent analysis. 


113. Thoi 


Dup heard quotes tfaal simulated what Americans would have 


heard beginning u^So4..96|)6 and 1960s if tobacco oompaoies had not taisrepresentod 
their own laiowie<^wd^d publicly that they believed smoking has delcterioos health 


consequences. Thhtu/Aiuericans would hatve beard bodi the Surgeon G cDcr a l and the 


tobacco companii 



isimultancoiuly that smoking causea canoer. heart disease, and 


other diseases. Cdasistent with my expectadon, this group's average Motivation to Quit 


(2.91) was ngnificaotly higher than that of the control group and SG group combined 
(3.10). In fact, the likelihood that this dlSerence between groups in Motivation to Quit 
fvas caused by bearing the six quotes is greater than 99%, 
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114. Tbe £>ct (hat this effect oner^ged at all is ranafcable. The nUQipulatiaa 
tl^t iadueed the change in xnodvatioQ to quit was oxaeodingly small: bcadag fine oce- 
itence quotes by tobacco compsnics or company employees. These quotes swd etcactSy 
what tbe SOTB group icspondoits bad just heard, so the tobacco ooiopaisy atetemnita 
offered reapastderda no new conteaL And the mi^aaty of nspotyifxil^ wete apparently 
^eady familiar with t§ba^ quotes, having heard them before tbe eitrvey interview, wtiicb 
^^autd niainuse their Ity had impact. Thus, any effect of the manipoletion ai all 

woddns agaiBst it szrd atteets to the £ao that sfatmiMite 
lanles can induce increased motivation to quit .smnlring. If 
lodged publicly what tfa^ knew beginning in ttte 1950$ 
i Hriff they would most IStely have done so repeerrrtly over 
:e admissions would most likely have received extensive 
likely subctandaliy incrcese their impact over what was 
^^^iexperimeat- 

US. In sum, ^^^ding of this experiment is consistent with tbe notiou dtai 

simultaneous exposi^TnlM l9S0s and 1960s and tberaafter to messages ffOBB, on the 



^creomea diMe vBh< 
astbeaebytob 
tobacco companies 
lut tbe )v*a»rh effc 




one hand, tbe 
the rbbaeco eompx 
smoldng Would Iw 



and otbeor public health authorities arul, on the other band, 
|>wledgtng the health consequences and addictiveness of 
led Americans' desire to quit smokinK and tbe feequency of 


actual quilting, iheraby decreasing national smoking rates. 

■ E. Are Bine fVnmi-Rl ne Shield Subscribers EHflertnl from Non-Subscribers? 
116. This litigaticct is focused on the beliefi and bohavica' of Blue Cmss-Blue 
subaenbas regarding cigaiene smoking, yet much of the evidence leviewed above 
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examines the belief^ and bebaviot of eensal public sample*, some of whom were oat 
^Ixie Cioss-BUie Shield subscribers. In older to confideody drsw inferences about Blue 
oss-Bloe Shield subseiibcis using data from tbese general public samples, it would be 
t^elpfiil to know whether filoe Cioss-Bluo Shield subsetiben differ sysiamatisany in their 
belief or behavior about smoking from non-snbscrtbecs. A ladt of difFereoce would 
^istify some confideo^injLn nspg data on the general public to make inferenoeu about Blue 
Blue Shield au 

117 . It is address dus issue uaing data from the SKBl survey, 

respondents m ,^t a^uvey were asked three quesdoiu to mtablish liferunc Blue 

fcfOss-Bluc Shield status. 

“Do you health iusurance that would pay /or some or all of tbc 

C 9 §$S[^'you care, or do you not have health insmmee at this 

.n^^^DGr "Is your health insuraaoe from a company whose nsine 

includes the ^lue Cross' or ’Blue Shield' or is it from another cotapaay?" 

S WHO ANSWERED EITHER OF THE ABOVE TWO 
"Have you ever bad beahh injnnence from a cxjtnpxay 
the words 'Blue Cross' or *6100 Shield' or have you oevo' 
from a ctm^any whose name includes the words 'Blue 
i‘? 

118 . Consistent with the erm^ctahon that these two groups of people do not 
differ notably, people who wcr never Bine Cross-Blue Shield subscribets did not differ 

^om subsetiben in their perceived relative risk of lung from smoking 

(Median =» 2-80 for non-subscribers and 3.00 for subscribers, p-.79. K’=1903). Likewise, 
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th* correlutiaas of perceived relative rtsk with Regret Unkippy, liiee lo Stop, and 
^^^elihood of iryisf lo quit were quite comparable for Blue Cros-Bloe Shield 

bfcrlbm (i«=.n, p<-Q01, N=Hdl; r=.08. p<.0l,N=1156: r=»,16,p<.001; K*307; and 
.10, j»<.03, N”512, respectively) «iwl fornoD-eubscriben p<.001. N=736; p-.ig. 

p<001, N-736; r-.20,p<001; N^16: and r=.16, p<,001;N^13, respectively). Tlic 

leots regarding die link beeweeu tmoldng and lung cancer 



ierent (p>*.12) fix’ Blue Cross-Blue Shield subacribers (22.1K 
certain, 25.2% somewhat cotaiit, 6>tV» eU^bttly certain, 
"don’t know" or reiiised, N“973) and aoD-subectibers 
, 9.1%, and 0Jt%, reipcctively; N’’^<03). And the igrpart of 
on General and the tobacco conqianiee was not 
Blue Cross-Blue Shield subscribers and non-subscribers 
some confidanoe in rnaldng inferences about the 
lire Blue Cross-Blue Shield subscribers fiom data on geoexal 
ioa-sub*cribets. 

Conclusion 

, this evidence support! several concluaons: (1) Anteiican 
.deresdmated the heaUb liste ofsmolring. {2) Smoking 
ere caused by people's belieb about the health consequences 
of -smnlapg, (3) Therefore, improving the accuney of people's belieis abont The hnalth 
effects of cmoldng wotdd have ted to a mductian in stnoldag onset and an increase in 
quitting. (4) If tobacco companies had made frequent, prominent public statements th^t 
iking causes adverse health consequences (as opposed to what they actually did). 
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Amecictns would have smoked less as a r^ulc, aad (5} Moat 1998 Blue Cioss-Bluc 
Shield subscribers believ e that when they began to aaioke, fliey did oat tecognize the 
health consequences end uddicuvenoss of smoldng, (6) Most 1998 Blue Qxxss-Blne 
Shield subscribm beKeve that after they began to arn n lw , they eveahitUy learned that 
amo^iag was dangerous and addictive, but Significant pocdons of thoe people believed 
I that they never adopt^^c faeUe& while amotatB, GO 1^8 Blue Cross-Blue 
subscribers ^^ve that if h*acco ccstpHues had ataoed publicly that s moWn B 

t- 

/-aniKiMi disease B ^ ftterive. these Individuals would hasn smoked lose or not at all. 

and (8) Blue Cruss^toe^tield suhscribets who nnokad are vny similar to noa- 
subseribers who leans of their bcHe£i about amoiems- which suggests dial it is 

tin general public samples to Blue Cross-Blue Shield 
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Footeote 




1 . Bcc*U£e respondents expect questions with diclwtomous poeitive/negstive 

xuswer choices to offer the positive option befkne the negative option md violating this 
eaqieetation disrrqits people's cognitive ptncessiris of the tjuertion ssd reduces the 
accuracy of their anitkim CHoIbrook et iL, fotdicoonng), these two r^ponsc choices 

in the Older in which diey appear here, 

odents (cboseo nndooiiy), the teqxmsn opdoos Were 
and the other half of the respondeats beard those respoose 
'This was dose to prevent presentadon order fiois blasiiig 
or the other of the rattsg scale (sec, e.g., Krosmclc A 
8 ). 

iOndcDts expect questions with dichotomaus poaitive/negaiive 
jhe positive option before the negative option 09olbtook et aL, 
lOnse choices were read to' ell respondents in the order in 



answer choices to 
faitbcainiDs)« these 


wlucb they ^>pear 




r theiespondenb (<^scn randomly), the responsa options were 
E, and the other half of the reqxjndents heard those re^ionse 


4. For j 
read in the order t 
options in the 1 

5. Because respondeots expect questions with dicbotomons positive/negative 
answer choices to oSer the positive option before (he neganve option (Holbrook ct aL, 
fartbooming), these two response choices were read to all respondenis in (he order in 
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6, Fot Mf the respondents (chosen rsndosnlyX the response opticus were 
read in the order shown here, and the other half of tha rMpondentS heard those response 
options in the reverse order. 

^ 7. For half the respondoits (chosen randomly), the le^jonse codons were 

read in tile order shown here, and the other halTof tire tespoadeau heard those icsponas 
options in the 

8. Be^i^se the distdhutian of relative risk acorcs was exonmely skewed (as 
ions oeoessarily made by convwitioaal parametric 
Thcre&ite, to compttte these cocrelatioiis, respoiideDts’ scores 
; Were converted to p ercmti iea to penxnt these assodationE to 

respoadenis (chosen modomiy). the response optioia were 
h^re, and the other half of the re^ondents beard those response 
order- 
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Cocleit’ Judgments of Answers Given iqr EBCBS Survey Deponents: 
Deponents’ Beb'eft About ifa« He«l^ Effects and Addicbinnaess of Cigarette Smoking at 

ihe Time of Smoking Onset 


ding Questran 



% 

Yes 


% 

No 


% 

DK 



At the time that th^penon becam* a regular dgaiette 

did bei^ smokzng eiganttM ingnejod 

pic's chances of cancer or empbyaems or 

icart disease or any disease? 


At die time that 
did he/she believe 
chances of getting Ii 
y other tenons 



^became a tegular cigarette smoker, 
eigareOes inenased fais/het own 
or emphysema or heart disease 


. At the 



th^Wmecarne a re^ar cigantte 
(bat smokmc cigarettes was 


At the hme thep 
lid he/she betieve ttul 
aokntg cigarettes? 



c a regular cigarette smoker, 
e^woutd become addicted to 


20% 77% 3% 


4% 92% 3% 


8% 42% 50% 


3% 87% 11%. 


89 d 3 1 tSi6PSS3n9 1 S266 Ci CEC9 ea'dl”! 3N r iNOTHba >.3'13Q ad Ud ,ES- 1 [ 


1003 32 M«r 


http://legacy.library.ucsf.edi>:/t!d/ijyq07a00/'pcilw.industrydocuments.ucsf.edu/docs/ryhl0001 


52434 5657 





i - I ty ^ ff 




TahleZ. 

Codere’ Judsmeats of Answcrt Given by EBCBS Survey Depoococs: 
Deponenu’ Beliefs About the Heaidi Effeis and Addicdvcaess of CifaietlB Snookm; 
After They Had Becoroc Regular Smokers 


Coding Question 


•/. % 

Yes No 


% 

DK 




At any other timi 
y, didbs/i 
XpeopVs cbancea o: 
’ diseasa or any ottii 

\ 4. Ax any otbes tiiai 
regularly, did bc/i 
hia/her own cl 




S- At any other limi 
^ regularly, did h Vshi 
addicted to smotdng 


18. Atany tmte, 
‘ canccTWMiuing 
in tobacco ot ci 


^ parson was smoldng dgatattea 
that emoViTig eigamtaa inciaaaed 
iuog cancer or emphysema or bean 
disease? 

person was smoking cigarettes 
that smoking eigartttes increased 
hm" cancer or emphysema or 
out disease? 



person was smoidDg cigarectes 
leva that smoioiig dgaraties was 


person was smoking oigarettes 
that be/she was peisoaal^ 


laum the nasae of a qMcdfic 
called a ezreinogen) that is 


84% U% 5% 


63% 2S*/. 8% 


?9% 4% 17% 


76% 14% lO% 


16% 65% 19% 
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T»W«3: 

Codm* Judemoits of Answers Given by EBCBS Survey i[>epoQeats: 
Deponents' Beliefs About their Exposure to Statemeots by Tobacco Companies 


)duig Questioa 


Did the pezson ever^^^|- hear ■bout, uty slatanect by 
soy tobacco oompany^^ ataoiODg dsHretteo inciEasea a 
iii|»OD'e ehaaces of geming 1 ^Q 5 cancer or eoqibyeems or 
disease or any om^Per^ius cEsease? 


^0. Did the penoii aveg 
^|oy tobacco carppaiiyl 
a peiUMi's cfaiBces ofi 


heart disease or any »mbus disease? 


j^r hear about, any statemeat by 
mokng dsazestes does not increase 
l^ung cancer or emphysema or 


1 l^Did the penoo evtr 1 
to h a rd^^p aioiii 
^oondnsm^l^tD 
mercssas ^Sm's 



isa, ^ hear about, any stiueineat by 
i^sdendfic evidence is 

r or not swoldn^ cigarettes 
les 9 f getting hmg cancer or 
any other sorioos disease? 


M- Did the person evt^^l^r hear about, any staiBmant 
^ aqy tobacco companya yo cifi c cancer<aiusing 
jihstanfie (also ealled|^^^^gen) that is in tobacco or 
dgaictte soiokc? 


12. Did the person cv g fae«, ^r hear about, any statement 
^ any tobem cooipi^^^^ whether or not smoking 
ngaicites is addictive^Mu>»»«,£j 


.Did the penoa eve 
' any tobacco oompa 


: hear abqot, any sUlzanent 
motdng dgsiettcs is ooc addictive? 


Did the person ever bear, or bear tituut, any statement 
by any tobacco company that the sciCTtidc evidence neg g r rirng 
l^e addictivaness of smoldng cigarenes is loeonolusive? 

the person ever beai, or hear about, any Etstsment 
i^^Sny tobacco company that smrtfc-ing agaietXcs is addictive? 


% 

Yes 

% 

No 

% 

DK 

6 % 

93% 

1% 

37yo 

44% 

19% 

43% 

42% 

13% 

3% 

87% 

10% 

I5%i 

58% 

27% 

12% 

54% 

34% 

4% 
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92% 

3% 

87% 

10% 
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Coders’ Judgmenis of Answers Oiveaby EBCBS Surv^ Deponents: 
leponents’ BcUafs About WbeQicr Tbcy Would Have Been Influenced by Statements by 

Tobacco Companies 


Question 



% % % 

Yes No DK 


6. If any tobacco stated publicly diai smoking 

Igwettaa wici M a es trances of getting Inng cancer or 

p^j^oqifayseaia or heart any other seriow disease, - 

Wold flkat have caus^^^wRoa to not start smeddns 
iaarettes at alL to soons than be/she did. or 


75% 16% 9y> 


cigarettes at all, to 
try to quit? 

If anyjdbacco 


not start ^iSaiSlIgc 
than bdfepigiS#, or 


If any tobacco e<| 
%£ a c 2 ncer>caiisiii£ n 
^make, would fluit hv 
%ndldng dgaicttes a| 
'^c/she did, or to tiy 4 
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Table 5: 


pcrcfivcd Numbers of Non-Smok« aod Smokers Who WUl G« Lun* Cimeor 


Number of People Who 
Would Get Lang Caoegr 








Out of 1,000 
Non-Smokers 


41,2% 

18.1% 

2.3% 

7J% 

4.8% 

44% 

1 . 2 % 

1.9% 

0 . 1 % 

0.0% 

13.4% 

0 . 0 % 

0.9% 

0J% 

0.9% 

0.7% 

1 . 0 % 

0 . 0 % 

0.5% 

0 . 0 % 

0.8% 


Out of 1,000 
Smokers 


12.3% 

8.4% 

2J% 

6.4% 

3.3% 

6 . 0 % 

1.9% 

6j:% 

1.4% 

0.0% 

21,4% 

0,3% 

4.8% 

1.4% 

5.4% 

3.4% 

6.3% 

0 . 6 % 

3,3% 

0J% 

4J3% 



-— 

^ 100.0% 

100.0% 

Meun . 

188.2 

433.5 

Median 

100.0 

500.0 


1,916 

1,936 
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logical Associatioo, Annual Meeting, New York, New York. 
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Kro snick, J. A*. & MUbiioi. M. A. (1987). Fsychological determinants of political op bi i o oa t ion. 
Paper presented al tbe Americsn ^Utkal Science Associatioii Ammal Meetixic, Ch i c3,go, 
minois. 

J. A. (1987). The sole of atntodc itnponaace in social evaluation: A snitly of policy 
pic£=reiiccc.pieside]itia] caadidatr. evalualioas, aad votine behavior. Paper presented at the 
Society for Expenmental Social Psychology Anmial Meeting, Cbarlottcavine, Viigi&>a. 

I^xosoicjc, J. A. (1988). Payduslogica] perspectives on political candidate perception: A review of 
seamh oa (ha ptcticolion hypoQiasls. Paper pMcoted at the Midwed Politica] Science 
‘"Association Atsmal lvtetin|L Chicago, Illinois. 




J. A. Boninger, 
pnstsnrr. Paper 
icago, Illinois. 



fk,J.A, CamotiC. 
amonc 

Assoda&m Animal 


J. A,U,P.,Aj 
rates on aoeial judi 




!>snick.J.A, 
reeaUWi 

^^NAasociatioD. Annual 



Bereot, M. 8: Camot. C. O- (1S>8S). The origins of attitude 

at the hGdwest Psychological Aasociadon Annual Meeting, 


M. XL, & Boninger, D. S. (1988). AneSQplontionoftfae 
of attitude scrsngttL Pqper presented at the Midwest Psychological 
CbioBga, Dlinois. 

J, (1988). Order of mfonoaiion presattadon and the effect of 
P^>er presented at the Midwest Psyehoiogicai Association 



I. A, 

xbengfh. 

,Chicago, miooia. 

J. A,8tAlwin.E).,E 
at the Ami 




C. C., 8t Boninger. D. S. (1988). Attitiida importance and 
on. P:qxT presented at the Midwest Psycikdogica] 
Chicago, minou. 

88). A comparison of two theories of the migifls of political 
d at the btidwest Psychological Associatlaa Aimual Meeting, 


8). The stabihty of political attitudes across the life ^an. P^ic- 
ociatioQ for Public Opinion Research Animal Meeting Toimito, 


, J. A., ft Caiiiot,-<^^^^^S). Identifying the foreign afEsirs attentive public: A canaparisoo 
of competing thsoiiarj^^r presented to the Mertboo Oeoter Seminar on Fomgn PoUcy 
^^^DeasionMaldiig, The Ohio State Lfoiversiiy, Colmnbus, Ohio. 

D.F., ft Kxosmek, J. A. (1988). The reliability of attitudinal survey data. Piq>er presented at 
:the Inter nariiw al Conforeacc on Social Science Methodology, Dubtovmk, YugosUevia. 

ft F., & Krosnkk, J. A (1988). Aging, cohort stability, and change in socio-political 
trofudea: Exploring the generational-perauteoce model. Paper presented at the ItUeniational 
Society of Political Psychology Ammal Meeting. Secaucus, New Jersey. 
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Krosmck, J. A., A Kinder. D. R. (19S8). Altering the fopnndetitn^ of ptynlir atypot! for the president 
^ Yhrousb p rimingr Reagan, the Irm-Contn afiur, and the Amoicaa ptibUc. P^oprecentad at 
(he American Political Science Assoelatioti Annual Meeting Washington. D.C. 

r 

licit, J. A_ &. Weiaberg, H. 1*. (19S8). libenl/conservative ideological uructnxes in the mass 
fic; A cnidy of attitudes hnvard polihcians and social groops. Pqicr preseated at ^ 
rioan Political Sojeoce Association Annual Meeting, Wasbmgton. D.C. 

,J. A. (1988). Oo^emmeot policy and dtizac passion: A sOxty of issue publics in 
nten^poniy Axnadc^^^i^ presented at the Sbambsagh CoaCsrence on Cocnmunicatioii, 

, Political and Aifect, lovra City, lowa- 




fC..Krosidck. J. 
f relevant infbi 
eering, Ctncago, 



dcKrotaick. I. A. 
STimQh'? Paper pras^ 
lUinois. 




D. F..AfKrbfiiiiclc, 
the Amoican Asso 
Florida. 


J.A. (1989) 
survey respondmis 
Annual Meeting. Si 




ninger, D. S. (1989). Altitude impottaoca and the valanced recall 
ler presented at the hfidweet Psyctsological Assodatioa Amital 


Can people detect the nSective tone of snbliminally presaoted 
Midwest Psychological Aasocialioa Anmial Moetin& Chicago, 


989). AgO'ielated changes in peer and pai«atalihfiiuaM on heavy 
and adolescents. Paper presooted at die Midarest 
Annual Meeting. Cbicego. Illinoi.s. 


89). The teliabili^ of attitudiiial survey data. P^ierprecemedat 
I^blic Opinion Research Annual Meeting. Sl Pe tnaliiug . 


ions of social psychological fi-ndingg on oomptiance Sot recruiiuig 
ted at the American Aaiociation {or Public Opinion Kcdearch 
iUlg, Florida. 




S., & Kroaokk, Public attitudes and American policy towanl the Anb-Isaeli 

cOT^ct P^jer the Interaatioiial Socidy of Political Psychology Annnal Meeting, 

1- A, A Alwln, ^^^^>89). Symbolic versus non-symboUc political Is ifaae a 

distiactioo? Paper preaented at tbc American Potitica] Science A.ssociaiian Annual Meeting, 
Atlanta, Georgia. 

>cic,J. A. (1989). The impact of cognitive sophistication and attitude intpoitance on response 
order efiGmis and question order effecta. Paper presented at the cooferenoe oititied Ordo- 
ij ^ects ID aociil and prvchological reagarch. Kags Head Conherence Centar, Kill Devil Hills, 
North Caiolina. 
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Kxosoidc, J. A. (1990>. The impact of s&cisficing oa cuivcy data quality. Piqterpcasestod ac the 
Anmiai Raseanli CooSarence oftbe Bureau of the Census, U.S. Depattment □/Comntecce, 
Washington, D.C. 


F" \ 

W.Kroai 



iek,J. A. (1990). Hew petspectives cm aum^ quastioOBaire cotucruction: Lessons from the 
cognitive revolutioa. tnvit^ presematioo at the 1990 Technical Coofeicac^e of the United 
States Qeneni Accounting OlSce, College Pailc. Maiyland. 

ick, J. A- (1990). Americaas' p etc e p d o m of presadeotiBl candidates; A test of tbc piojecticm 
bj^lbe^ Paper presented at the Midwest Political Scieaee Association Annual Meeting, 
Qiieago. TUlpois. , 




ck. J. Ap & Ben 
branching on af 
Association for 


ick, J. A., 8c. Alwin, ^F. 
symbolic and xkuH^^ 
Psydtoloey Atmu j^l^ 

J. A. (1990). 

ft 


. 0990). The impact of vodsal labeUog of response aiicoutlvae and 
Hupncient iiliability in sunr^ia. Paper preseiited at the American 
iploion Research Annual Meeting, LJtacasfer, Pennsylvama. 

2 990). The stability ofpolitieatprefiueaces'.Coii^arisoDS of 
; attitudaa. Paper pteseroed at the latemadonal Society of Political 
^|lg, Washingtott, D. C 

giving of anitude olgects with aitimde tneasuremeut techniques in 
Instability. Paper piesanled at the Summer Institute in Survey 
iigxirity ofloachigao. 



'**S*f. A- ^ (1991). The effect of question order and aitinulc importaime on the 

^Is^^souIkuos prasaniad at the Midweston Psychologioal Aasociatioa Annual 

^ Meetius. Chia«o,;nhnoia; 


M. gc Kiosnick. ^^^1991). Attituda measurement reliability: The impact of verbal 
labeling of Kspoo^^mminives and brandnug. P^>er presented at tha Midwestern 
Psycboloiicat Asm^ti^Aimual Meeting, Oueago. niinais. 



‘*°> P’ Rroeaick^J, A,, R. L,. & Li, F. (1991). The focus of judgment effset: A 
question wording to hypothesis confitmaifoti bias. Paper presented at the Amoican 

Association for Pt^^^^^nion Rassaroh Annual Motring, pboenbe, Arizona. 

tide, J. A., Boaingei^^^luang. Y. C, * Caniot. C. Q. (1991). Altitude strength; One 
censtiua or manytreCnacrWistructs? P^>er piesexaeil at the Hags Head Conference on 
Attitude Strength, Hags Head, Nottii Carolina. 

lick, J A (1991). Researcdi on attitude importance; A summary and integieticin. Paper 
presented at the Nags Head Conference on Attitude Strength, Nags Head, Norlh Carolina. 

J. A, St Bereot, M. K. (1991). Mem^ (or political infonpatioa- The impact of attitude 
^importance on selective exposure, selective ejaboratioa, and selective recall Paper presented si 
tfac Society for Expedmeatal Social Psychology Annual Meeting. Colmnbus, Ohio. 
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Krosnick, J. A., & Brannon. L A. (1992). The impact of war on the ingredients Of presidential 
eveluatloosT Oeorgc Bush end fl>e Gulf conflict, ftper presented at the Coofetenoe on the 
Political Conseqneaces of War, The Brooldags Inslimhon, Washington. D.C 

M. K., & KntfBick. J. A (19921- The relation between attitude impottancc and knowledge 

stniccuie. Piper presented at the Midwest Political Science Association Annual Meeting. 
Chicago, minou. 

W. K., Culp^iper, L J., & Kroeniek, J. A (1992). The impact of question oidei on cognitive 
efiort in survey re^^emditt^ Paper pieaented at the Sixth National Conference on 
ITiwJeisnduate Re^e^^^^^niveraity of Minnesota, Minneapolis, Minnesota. 





J. A,&Bt«xmo^lL. A<^(IStSt2}. The impact ofwar on the ingredients of p^dential 
wevaluationa: OeorglBoaM^ the Golf conflict Paper preseoied at the Ameiican Assodadon 
' for Public Opinion Annual Meeting. St. Petersbuig, Florida. 



S. S.. Sc Krosnii 
aophisticaiioa. Pi 
Chicago. lUinois. 

, D. S.. Krosnick. 

inteiesl^gBBfth to' 
Associ 



Culpepper. W„ 

. attitude surveys. Pi 
I Meeting, Chicago, 

M.K., &Kraeiiii 
relevant judgments. 
Meeting. Chicago, 

l^eSMa|clc, 1. A, A Brann 
i evaluaticiiu: Georgi 
Political Psycholoj 




1992). -Response effecti in surveys as a fimction of cognitive 
,ted et the Midwestern Psychological Association Annual Meeting, 



Bereni, M. KL (1992). Imaginatioii, pemeived likeiibood, and self- 
importaoce. Paper presented at the Midwestern Psychological 
Chicago, plinfw* 

ick, 7. A (1992). The impact of question order on satisficing in 
presented at the Midwestern Psychological Association Annual 


992). Attitude iizqioitance, infotmation accessibility, and attitude- 
tied at the MidwesiEm Psychologiea] Association Aimoal 


_The inqitact of war on the tngrcdicota of presidential 

id the Gulf conflicL Paper presented at the Imsrnalional Society of 
Meeting. San Francisco, Califeunia. 





...M.,Kroauck, J. |^^i^^euning,M. (1992). Rationaltzatiwi and derivation processes in 
political candidate evaluadoo. paper presented at the Amoican Political Science Association 
Animal Meeting. Chicago, lUinola. 

I. A., & Branno&,L. A (1992). Effects of knowledge, i nte m t, and esposure on news 
media priming effects: Surprismg results ffom multivariate analysis. Paper presented at the 
Society lor Experimental Social Psychology Annual Meeting, San Antonio, Texas. 
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Smith. W. R., & Krosoick. J. A. (1994). Sources cfnoo-diSerentiztion «nd mental coia-£Lvpui£ ia 
stnvrys: Tasts ofsuisScmg hypotheses. Pi^er prwented at (be Amancan Asaorinb'oii for 
'public Opinion Research Annual Meeting, I>tnvers, Massachusens. 

S.. Kicsnick, ]. A. (1994). Mail surveys fox election forecastiiic? An evaluntioa of (he 
Columbus Dtcpatch PoD. Paper {Resented at the MidweetemPsychological Asaociitfiog Annual 
g, Chicago. Illinois. 




. S., Krasnick. J-A., dc Curtin, M. (1994). Mail surveyB for election fbcecastillg? Paper 
ticsenud at die Amea^pan Association for Public Opinion Research Annual Meeting. Danvers, 


J. A., &, Bjaooon. 

looL Ptqierpresi 
^cago, Hlinois. 



^ A. '^995). News media priming and (he 1992 U.S. piesideatial 
hte^at^e American Political Scioice AsGociarion Armnal Meeting. 

S» 00 («&»U^ 


? tftitndc stabUiiy and " 
presented at the Ami 




). Altitude impottanee and attitude change revitiiedt Shifts in 
L«nt reliability across a piesideatialelectiancainpaigiL Paper 
ebological Society Annual Meeting, New York, New Yodt. 

»5). Designing rating scales for effectivE measarement in 
International Coofcrencc on Survey Meatairemeni and Process 


ith, V/. R. (1995). The causes of survey satisficing: Cognitive 
Paper presented at the Midwest Association for Public Opimon 



M., Fabngar, L. J. A (1995). Coattaating attitude isyionance and 

lilective issue unpot^Dbsr'ASiiitude properttee and consequenceE. Pqwr presented at the 
’dwestem Paycholo^is^^Ai^ooiation Annual Meeting, Chicago. Illinois. 


ML, & ICrotnick, J. 
Midwest Political 


J,. & Knanick, J. 
^Sece^Oity, foOm ^ ^ 

Washington, D.C. 



Ballot order eSects on election outcomes. Paper presantad at 
iiation Annual Meetizig, Chicago. Illinois. 

Mediaiore and modenton of news mnrtia priming: It ain't 
ited at the InternaboDal Society of Political Psychology Aimoal 



^ Kmsmek, J. A. (1995) Education moderates response effects in surveys. Paper 
:ed ax the American Association for Public ppmion Research Anniial Meetinp. Ft 
idcrdalc, Florida. 
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Smith. W. R_, & Krotnick, J. A- (1993). IvCental coin-flippuig «ad non-dififemututioii ia nzivGys: 

Tests of satisficing hypotheses. Invited address at the Midwestern PsychoJogtca] Aavociiaion 
^Annual Meeting, Qiicago, niisois. 

. S., it Krosnick, J. A- (1995). The relation between age and susceptibility (o attitnd« change; 
A new approach (o an old tjne^on. Paper presented at the Midwestena psyebologica] 
oedation. Annual Meeting, Chicago, Illinois. 

S„ it Ktosaick, J. A. (1995). Moil surveys win again; Some explanatioas for the soparior 
of tils Coltsnbtts Ih^patcb poU. Paper presented at the American Asaociatiao for 
lUc Opinion Rea^ieK^ A^iud Meeting. PL Laudodale, FloncU. 






A. I.. Krosaicif?. A., Caeioppo, 1. T., & Vissex, P. S. (1996). Candidate aseossmoits 
evaluative tpaesp-P^F^preseoted at the Midwtstem Psy^ological Association Annual 
fileeting. Oncago, 

. Y., it Kroaniek. J. A. (y^. Attitude accessibility and importance levisttad. Pap« 
ad at the Mit^i^^^Pqrahological Association Anaual Meeting, Cliiokgo. lOiaats. 

ick,J. A. (1996). L i nkin g st^ ey question structure to data quality; The inqwet of no-<ylgion 

Paper preaCTKS^i^he conference on'Qoality Criteria in Survey Rsseatdk,* spoosoted 
the Wi^d Assoc^ati^i fiy Public Opinion Reseaich. Cadmabbia, Italy. 







M., Fabri^, JL 
importance in moi 
ianee Assod: 


(tSt96). Kews media priming during the 1992 U.S. presidmda] 
:a>tsd at the Intematianal Society of Political Psychology Ammal 
Colunbia. 

ictc,J.A; (1996). The roles of peisoQal iiiqM>rtance and natiouai 
public membeiihip. Paper pcasentad at the bfidweit Political 

Meeting, Chicago, IlUnoia. 



. M., &. Krosoick, Can issue public membeiship be triggered by tite Ibreat ofa 

policy change? at tbe International Society of political Psyctwlogy Annual 

ting, Vanoouve^^® Columbia. 

I. A., & Viisar, I 


C h a ny^ in political altitude strength huough the life cycle. 
^ Experimental Social Psychology Ananal Meeting, 

M., & fCrotnidc, J. A- (1997). The in^ctofpolicytiiange threat on issne public 
membership. Paper presented at the Midwest Political Science Association Annual Meeting. 
Chicago, Olinois. 

id. A, L., Krooaidc, J. A., Cadt^. J. T.. Visser, P- S., A Gardner, W. (1997). Attitudes 
rtrd political candidates predict voto-tumouL Paper presented at the Midwestern 
Psychological Association Annual Meeting, Chicago. lUinois. 
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Aiticezt>raiKl A. L.. & Kiosiiek, J. A. (1997). Rfispocse order efifecis in dichotonums questions: A 

social decirtbilLty exf lanacioiL P^>ez pmented at tba American Pfychological Sodety Aamul 
Mflociag. Washj^on. DC. 

Ll. J. A (1997). Miiaculom accuracy in political surveys: The keys to success. Presentation in 
(he Federation ofBehzvioial, Psychological, and Cognitive Sciences .Semtner on ScuDCe anti 
Public Policy, Library of CoDgress, WasttioglDn. D.C. 


:k, J. A (1997). Non-altitudes and no-opinion filteis. PigMT presented ar Oia ConAroice on no 
iopinion, tnstalnlity, change in public opinioa research. University of Amsterdam, the 
'etherlaods. 




J. A (1997) 
iUly, end 


Y., dcKroeoiek. 

ibility. Paper 
icago, Illinois.. 

, A. Kioaucit. J. 
tioQfl disrupts 
Eaatioi 




ttierence Metiaids 


.eugih. Paper presented at the Coolerence on mapimoD, 
lie opinion reacarch. Unrveraityof Amsterdam, (he NelherUnds. 

|S). The relation between attitude impoctance and attitude 
at the Midwestern Psychological Associatioo Annual Meatiqg, 


R. T., Sc MitebeU, R. C. (199S). Violatins oonvecsatiotul 
processing of survey questions. Paper presented at the 
Lc Camion Research Annua] Meeting. St- Louis, Missouri. 


; staled preference methods to assessing the valse of publie goods. 

[ Oceanic and Atmospheric Admini.stratian Application of Seated 
I Resotqce Compensation Workshop, Washiiigtcai, DC. 


,J.A (I99S). Impli 
^ Wndling of natural -. 
^^^^^tmosnherie Admini 



of psycholo^cal research on Justice and cxsnpcauntion for 
cases- Paper pnsentad at the National Oceaoie and 
ilicatioiL of Stated Prefereace Methods to Resoorce 


^^pompeosation Wosk^toprW^hington, DC, 



J.A (1998). Ao 
data 

'sponsored 



b: How a iiandard practice in many survey otgaiuzations 
presented at the con fe r e nce on “Quality Criteria in Stnyey 
orid Association for Public Opinion Research, Cadflaabbia, 




J. A, Lacy, D., & Lowe, L. (1998). When is eavinnunontal danuge Americans’ most 

problem? A test of agenda-setting vs. the issue-auention cycle. P^ter presented at 
InteRzational Society ofPoliciesl PxyeWogy Ansual Meeting. Montieal. Quebec, Canada. 


i Krosniek, J, A, Marquette, J., & Curtia, M. (1998). Impitjving election forecasting: 
Tocation of undecided rnspondents, identification of likely voters, and response order eSests. 
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-Deposition number 

-Name ofdeponoit 

-Ql 







On each row, pieun 
ipo^itiofls you have 901 

Pleaoe read over 
Buiiar with ifaaat. 

You should have a ^ 
ownto th« depodotty 
A) sre fiiUy &nuliar 

Please read the eoir^ 


spositioB aoinber md nama of dqjenent so that all tbs 
I to one tow. 

ling quastioos on tfaa s fta cb e d list and become very 


) of “exhibits.’’ These ai« the written maieriils that were 
^heir dsposiaana. please read these through carefitlfy so 


fonedepoaitian to getthe ftai for bow the queshooiag 


Please answer each of the qfaesttons on the attadiod sheets by typing the spp rop ii ste 
tweia imo the apptopriaie calls of youor Excel spreadsbeec. 


|Hcr arc toiae specific guidelines reganting how lo an swer the corfing quesnone.; 
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• v Ok I r 


BEST 

COPY 



-Adwct uch codiaK qartrion id one of three wtys; "Yea", Ko”, or TDIC''. 

'Answw a question “DK" only when the deponem never said anything duH you 
could use to deduce an answer to the coding quesb'oa 

•Bear in «njnd that • deponent mey say a variety of dilfisrat thing * throughout the 
depoaition that ate relevant to any one of die coding questiona. Please read 
cooaidtr evovihiiig the depo n ent said on a topic in d^diog bow to at u war aocb 
^•ding questiaat. 


•Whea youB 
questions, pit 
aumbs(s)of^ 
(e-g.. “Q 4 "). ^ 
atmmtsg eej 

-Some coding 
about bow yo 

Asytionym ft 
Ifhaving Aa 


d text in a tranacript th*r justLSes your answer to one of die coding 
the teod daddy in red peocU and write nan to the cuele the 
^^^ttionfa) that you will answer nsiag the cireled intionnatioo 
leaaqcucle a^ of the text that waa relevam to and oarfiil in 
question. 


IS include the wtxd ^cause”. Han is some tnfbntuniaii 
define the word '’CBuse** in your own thiniring- 

■ it "contrihiae 


p^enon to get B, this means that having A ijjsifiHggJiig 
^MtiingB. Ooe exacnple of such cansality would be if 

have A doea not have B, and if evaryone bM A alao 

I only reason these lanB- people have B is beoaiae they have A. 
A U neoeataiy and snfificienc for a pezBoo in have B. 



But it is also 
petson's ehao^^^^ 
ha««8. And a omej ^ 
have B have 

f 

•When loaldnini'l^ 
NOT have to 
depofitiaii. 
decide what 
wording 


bar A can be a cause of B beautsc having A mcreaici a 
ding fi inaa p e rfec tly. Thst is. some people willioat A can 
tpte with A can be-without B. Bta some of die people who 
they also have A 

MSitian text fin-(be answer to a coding question, you DO 
^XACT wording of the coding ipieation used in the 
a to read (he tiansedpt and use the infisaaatiao there to 
Ideoi meant to aay without worrying about the exact 
dt metriiiwi the Coding diaet. 


-However, if nevff provided any mfiumatioe with whi^youean 

answer a c o din g question, you should NOT try to guess what the deponent 
WOUXjD HAVB said if be or ihe had been vgir*rt another question bO or 

was not aalrnrl {jutead, you should only answer (be coding questioai iiihig Wriny* 
the deponent actually said that is directly relcvam in anrwartng Ibe qaeations. 

Please code all the other depoeitiona that you have. 
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V u a 


. V*. i 


ii ."V*! V-- 1 ^ 


'J '^ ■• 



?. If you have aay queatiooa or difgcnltioc, please cotitaot Jon iCmniek w get help. He 
can be teached at«14-2»-349tf (office). 614-«47-9571 (besBeX 614-579-7983 (cell 
pboM), or by email. 

U lO. Do NOT discuss ANYTHING about this work with ANYONE other than Jon 
Krosnick. Do NOT show ANY of the wottixi mstenals you get for this work to 
ANYONE. 
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ui0^ Xasdmaa oMsctot Aat ./(q }X 9 qw]«k Am ‘noqs jesq la ’itsq am oosisd aqi pm X' 

^snasH’ mouM Aipo ifoe sa assac^ Itsaq jo «iiBcXt|disca a AOtm Sonx! 
saamqo t.tuMipd « saMastn c a u a TsS o SuGtoos ]oa jo oi n aAttnpaaoaj s] asOEipxM : 

scp i>t]i Xasdinoo oaoeqoi luatnaSKis An‘rnoqt j«ai{ A‘jBaq jaM aocEMl aiji piQ '( 



mai; lo inasXqduo a jososo 9iin| ttnna^jo •a^nrp s.twEiadi^ 
mx) Xacdam oaocQoi Am Xq i a w w wtf As *inoqB J»q jo 


^aCMSTp snouas JMpO 

a—agip T«—H M in Matia^ gmH gimiag jct ia;>uxfi 

mnXoadoiDO ooo*qot Xq> Xq maaamt Xnt 'jnoqe jcsqjo ‘j^peSiuSaos^ ai)i pm 



sooaas Bqto Am 
vn $»op tauuaSp 
otp PH3 0 




^pnujctp Sdb|oqb 

aASTtsq aqJ/aq pip ‘XtAfoSaj sajianSp Siii:(Otas ckm tnuad otp 



X([«iioCJ»d AM sqS; 
^jaqioXmTV '8 


Ittl 

at^a/aq mp aMqsq aqs/aq pip 'Aqocs opeuctSu JtinlaJ c smtooq 

4»(do*djc9>^J 

•A9|i»q a<(c>s"t pi? 'X[Je|n8ai sftjiAisSp Saploius «■ a mauad aip 


tetp 3A3iiaq pip 'Ajfoias auaJsSra js|nfai« amooq 




O) poAippB amoMq'piTtOA 

•4 


maq A tsiKXqdtaa A Aoaso Soni SoTBsS JO saaoip BMO 
SAarjaq oqc^ pip ‘/xJirnSat tauuiln Sopioiajs s*« oouad atp 



sei^ sajuuaSn 8ax^uUid 
aomatpxv S 


oiat AiQO Am jo 

pasiaADi ■ajjangA 

Am TV 'p 

iotBioq)a.Ai»A*1 

Unq JO masXqdoB a Jaaoco Son} Sop)*) jo nooaqo qao jpq/sn^^nAm BmojcSta a 
i«ip»Aaixaq«q«/aqpqi''j»|oTnsausji9pj«inS9J>M>isa*Qisa«»^Pg^^i^30n)aqiJV 't 





^anatip mopai Jsqjo Am jo attafcjp 

tnaq lo WBuA\tdxno jo jaauva amq SoinaSjo g aasqo r.afdciod possasam sapajcSp i 
BA*n0<(aqt/9(ipni‘XtJefiiSajs3aajB3p8v^oaBsiAaDSBdMpiBq)etizt(»tpoXBBiv Z 

twaanp inopw ja qwj ^i 

JO avBJSip jAaq jo BwasXqdcBa jo Aaura $m.\ SamtSjo taacmp s,aidoa<l pacmaui aH»a9u Sirn^nu 
mpaAa|iaqaq(/0qprp<jai:|octsau3JK8i£>JeiTisiusacaosq txossdaqiieqiaaiaaiiiJV I \ 


SMOiLsanO osiaoD "c 
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13. Did die penon ever bssr, or heiff about, any sUtomeot by any tabaeco company that 
sznoldog eigarertes is noi a rirt i c t i ve? 


14. Did the perscm ever hear, or hear about, any itateneni by any tobacco c ompa ny that tfae 
Ki^Ee evideace regsdisg the sddictiveness of unoldnf clgarettM is inconclusive? 

15. Did the person ever besr, or hear about, ny settoneot bry any tobacco campany Uiat 
ig eigareaes is a^^ctrve? 



16. Ifany tobacco eompany had stated publicly that amoktag cigarettes increases a person’s 
chasocs of getting long cancer or empfayeema or heart tffte a tr or any other aciione dis ea s e , would that 
^have^usad the person to oot start smokatig oi gg efl as at all, to quli. to quit sooner than he/ahe did, or 
“to quit? 



If any tobic^^^iiB^hay had stated publicly that seiokiag cigarettes is addictive, would 
^ve caused the persoi^ noMart smokiBg otprettea at an, to cpiit, to quit sooner than be^itie did, 
Ijr 10 quit? f 1 


I quit? 

^18. At any time,‘'did 
ia caremogen) that is 

19 Did the pi 




know the naitM of a qpeciSc cancer-causing subataoce (also 
or cigareOe smoke? 

iear. or hear about, any statameni by any tobacco company nsming 
also called a carcioogeD) that is in eobaeco or cigarette snake? 

ly had sbted publicly the name of a czocerousing substance that 
that have caused the vmwu to not natt vnwiirmg cigarettes at 
'she did, or to tty to quit? 
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»l|; pen ‘uaMaiAjauB aooqdsp) n xx»u»dx3 saaX rx»^at mq) vooz axvq t<thF 3t>p|iOM 
fijosujadnt aqx 'uoi^tn aip SoistAiaditt poe ‘tmcj oopsopoid gi imiMju|» Bi loaooa iO; 
joj aiqisnodm an Xatu. ‘S^iqi Xppa/^ owunoj acp jO qats /Cwp no si joepuadns y •vat 
pat siosvoadns ynj* .-sXaAMS •Oopdafp) IffaS ® I»*nw> w» swsiAwln*aadiO 0*0. 

'smcii XpTut pot *TifiiisjaAiioa poa DonaaAOid [■si\fai ‘taopatumi 
AMujBiin ao MiAM iixiopqipK at o&japm 'noiiippt tq uoBM^SBiims ntCoud tip oi oiwliai 

ciotlAioditt itV ■oo^Viiic^uocTAJodnsatiaqdb^pMCBuadxp^lp^aodiitMipisaS 

b)0$ iCjociAJOdns 

it 

^pMOinioiu »q IK Xoi 
JJTOOApCSflE 

(Q Stnpjoppi snoc. 

JO jww aApt w i i n ^^^ 
iLioarnjo sioodn [fy \ 


Mp-nj peiwanpop pet xoponp laoCc 
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9 oni^ pns ‘Snpsai ‘loaonmiau 9 o>o 9 t» bs Xq paqwagu n 
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VoiMaywtaiin suoqdam no T~'T-~*TI~' ITP "Tl J** 
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supervisors ud ans tmooj tbe best in survey research. They work closely with the project director 
and deaign team in developing the field pmoedures for a project 

The lip<* supervisors or monitors ate respoBSible for the direct ovetsii^ of isdividnal 
oviewen. Th^ andio-OKSiiTar the intervievs bong conducted. They evalnace the peifbimance of 
interviewers in perfhnnitig the Imerview on a set of criteria established by the Operations 
r. They also check the accuracy of interviewer recording, as wcU as intatviewing. 

Traislag ofTelaphoae Intcrviciecri 

Ail intervieweis who work for SRBI are thoroughly trained both in general internewiiig 

and speeili^'st^dy ^rotocoL 5RBI interviewen follow a gcnaal manual on Imerviewmg 
by our operabons saff The areas, which are conn tiered important 
traijdng of interviewers, rcgatdleas of the specific project, isclttde: 



^^^oewlnies. which 
id the general backi 



Adi 

snx^liogprocedl 

An understandia) 
foDowing them 


The role of the 



Mediods for ov< 
Intarviewer b 



ling pr o ce dures and the imporcaoce of rigorous adhereiice to 
ic fieW 

c selection procedures within a unit and the import an ce of 
ly as the b e tween unit procedures; 

in the sinvey process; 

for setting 

ag initiai agreemeDt to be interviewed; 

itial reluctance to schedule or agreemeotto be imerviewed; 



the interview sanmg — how to be eotuteoiis, neutral and nao-intrusive; 

<4 

How to avoid bi g g ^ te^onses by votbai and ooa-veihal cues; 

How to aak and ^g^^^osed.eii<led quasiioos; 

How to probe opei>.ended questions; 


• How to control 1 


ics and digressions witboui nflbnding die r t pood en t; ai^ 


How ID reaasurc respondents iboui the cocfidenuality of the infonsatioD ooliected and the 
anoByioicy of survey reapeodeats. 

Tbc Seld director in coordination with the project dtrecior develops special (raining maonals, 
(ho-visuml materials, and field kits for use in specific studies. Additional ciainijig materials would 
' include' item-by-itein incerviewing specificanocs; decision algoritfams for contact and 
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Iquudd procedures; procadurvs to msxizDue the probability of Obtaain^ SCOCillVC zofbnBSiOn frota 
rwponHhnn; proper CAT1 reoordiiig procedurss; and ■ d dirirm al repoiting and <|nality conlrol 
rtquimnona for the specific study. 

Training Sessioiu 

At the beginning of each study, all assigned field stafiTpstidipaie in a Mies of mining 
sessions. Tnuning may be thought of as being divided imo two segments. Tlie first phase of training 
lores review of die general principles of survey resenreh and interviewing. Tbn second phase cf 
ig deals qiecifically with the retiuiKmeots of (he Study ttbsod. Openticnuaiy, both sets of 
inioRnadoa are oovemd simoltaaeoiBly in training scti t i i ins . In these sessioiis the qiecific 

of the stu^to be performed are used to breathe })& iaio snd to demonsbaie how (he 
^ipeial principtea of arc actually oparabanalized. 

i^pnduoed by tba SRBI project dincnir nd field diiecter. Ttainiiig 
^ mterviewiag ^iaeiples and tmiigue study pmeedotsES and 

iewen access to (he CATI equiiuoeut and pcper queanotnuiies 
ey instrument and to p eri b n n practice interviews. On most 
issue is to ensure that the iaterviewear andentaads the 
lesdons are asked properly and le^otues ■« recorded properly. 

!ng period was devocnd to qunstion-by'.^IuestiaD qjeetficalions for the 


The actual 
poss review not on! 

neats, but alao 
I CO gain {aBuliarity 
phone surveys, (he 
^ deonaite fully, so 
C^nseguently, much of 
interview. 






^The first 
^purpose 

_ -(andaMSawe 

project 
survey, wc 

> 10 be used in! 


Next, we reviewed 
problems that ini 
Fiiat, the train 
loaSt the probe 
Soriea dapeni 
lUgfa tbcCATI 
und-robin exercise a 
project ita£ This 
bm etready beoi 







session was spent in enauiingthat the iateivieweis fiilly undnnnand 
lie, the value of the leaearctu and why sro cant mka no for an 
). AHv an expigDStioQ of the prefect, iti iigpotbiDoo aod key iasues, tlw 
~c cooitacT. screening, and ftgllharjf prohxol to be used on this 
.c contact procedores, cwintact and screening script and aelecijoa 


leraaire. the qoeseion-by'quemen specjficatiims, and <]iisstions 
ive about the surrey instrumoits. The instnimmit was reviewed in 
■gb the bard copy veteioa of the Questionnaire — roviewiag the 
the ^wdficatioiis. and comingad branehiDg of the question and 

previous aoswuT. The neaet part of training was spent going 
'quesdoaDairc, on serten. Thu portion of the nainiag is conducted u 
^ewen reading the questiona and recording the answers of ana of 
the mterviearers with tba appearance of the CATI screens, after 
with the herd copy iastiuincnL 


Next, the imetviewen conducted practioe interviews on the CATI system end the paper 
tiaanaltes. The sapervisois batched the interviewers onto a tot program. Half of tte 
iewsis bring mined acted as inierviewcis, while the other half acted as reapondena. Afis 
kttng «a interview, (be interviewer stod the respondeat revened rolen. The tninea and 
IS monitored the rola-playing interviews. A final rennd robin session was hdd to be ante 
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tbK aU of tba intarviewm usdemood the survey instruments end speoiflcuiOBS, and that piubiems or 
quectiom idastijGed in the mlo^laying sessions were iiloatived and resolved- 

^ Tbe last pen of the oaixijiis sessian was spent with the tr ai nin g uuati going over peobleou or 
^estiaDS that hid arisen during the pcactiee intorjewa lod answering say final questions. Oaee the 
n^intng team w«s «♦**"*»< that the interviewers wore pr e pared to bogin incerviewmB, tbe fim phase 
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^ Alter the Qnt fismal trainiiig session, inservlnwcr perlbnnaace was momtored and mdividnal 
imtnictioos wen pnrvidad. At the end of the first week of iDtcrviewin& if significant preblosa 
Enveloped, a second senon was held to coirea deficiencies. 
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09 M Q. I 33 •«.-> < 4 % rux. «3r 

«! TO 0. #31 X V 3 > PWf 

03 TO 9 . V 72 ■ ■ --> < i ^ n>Otl UaO't saaw 

90 TO O. » 32 ^ T > <TeL> icfU«4 


••* OOE»:osi ♦ 32 ♦** 

•y.X* ■>4kOg^mr uorrM ymt rlffjrr.'lbM Um J<^ P&cJAO«Bt CIlOTPA )kA« dM« in 
>uu»4lA«B «ai« A««u«* «ualn9 p»ft«AB«Aey. . imiau CkolCcA> 



1 > AAMlAnt. 

2 9 ^arj g— tt » 


nn/*5^oo 


A J> 

« > TPlx, or 
» > Xtiiocr 

^ UM'T 

r > rvot) tiefvaM 


X:xe ftf 


IJCfP^^T CAPt. tt k«Oulrl rvM^ly Klaif) K3» a X£ I COtflO 
“ QOSSr, «««A ti ypu’xB Qpt eMMfAacaxy 



iXatm 

Lssuv^v Bnr^ng Aip pr«aia« 0 cy.. » fllrn*? =90IC13I 

< lx drce2JLBa«« 

« 2 » Tpsir good. 

< 3 > Cood. 

< 4 » T*ir, or 

< S X foorT 

« « > (VOL) Ooo't 

t f dortiooo 


•tovoO VO« POTOOfWUy. 

-C.3- t*io u»t ^ lUfc. »*»• rod 

mvaT 

I > TO* 


vho4 9 eiguottof a* 


I 0^6r6S9d9 E 6^86 Oi. CCCd 




ss'd^-i 3NEiN«mw« ABnaa 


wo et’: 2 1 


^902 C 2 
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<30 

TO 0. 

• 

00 

TO 0. 

4 

90 

TO Q. 

4 

• »• omsTioit 

1 Q .3 

— Den' 



at 3 

35 --- ^ 5 

it ■ II ■» < 4 

know] 


> M* 

> 3WI«*L kJiow 

> M«u«*4 



X'XX ‘UK* •> (MI«4I Of . 1^ uOttJLO C«»Xly U« » 4.0« i COVii€ 

aljvo Q«t T^t 0BA7 <lflUS« ^-rm i>< 31 ^' n«« CMpiCfcftly •U2B. 

Shall t rcarf the cfuactA.**! »m K>r« tlM7 





first. Air^jiV O>o Lrre ^ ^y*. h4v« yau snoAid 5 «r 

.MCST 

00 90 g. • Sk I » < 1 > f«9 

00 90 Q. # Sd .1 ■> c 2 > Na 

CIO TO U. 9 .10 ivn> < 1 > Iirm'r 

CO TO sQ. 9 ^ > Bo(94ie<d 


»»• 00 
-0.9- 



< *«* 

youc *iicl4« LLC^r hSv« Asskod 200 «i9AC«kL«9 




I il9< 



t > Yea 
i > *m 

3 > Dan'e kfiov 


0«/25/00 • ajli »« 


4 > •eenseo 


«|nee9 or u\»k. it r*«Iiy n«kp us « ket i.z X aoola 

0QS99« vrOk It yw'^e mc ce^Iexaly 


Bked 100 oi^ArettM sr 


t>Ve ^USJtiOA OBC MM'S tiSM? 

your sntlrs life. bsTV ycna 

1 > Y«B 

2 > lie 

I > OOft't tBear 
4 > Pej^ed 


T*«ee* * 1 ^ All the <pe j Ti.oae 1 heve. 
moo TO CCIT CMXl 

«» < i > S/O -C-4/4A^IO/Ue/Kr4 SNOCOI 

< 2 > • 

TO« ♦ 39 *— 

TtM 90 SCUCT OI10DT J StOfTLC ALL M 
< 1 > aOOT A 


I &^S^6S3tt3 ^ 6zee oi CCC9 6S*d"n 3HixNy“nya xanaa nd wo 0^:2 
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f;o "n 0 • 

CO TO Q> t 
M TO O. # 

— ^pcctic Ttkrsm 
all «« 


4i1 Mi»a> c 

9 

> 

ftartna 

9 

49 ——> « 

3 


CSI003 

C 

40 < 

4 

> 

fllOOT 

O 


AIVSVCtf 



** OOW?TtOII t *0 *** 

« OPUfiXItOlM AUOCIATEfi HlTI TBS3 OUBSTXOM 
If QOOtA TtOJB » I CELL « HTLl 

AKO Of 3) eo CQPCC9) 1 

TiLVM go TO Q.f a:» fO g.t Li. 

«< aMOiTioMu* ASCOCZAJC0 vim THIS qowtiob 

If OOOtA RAOCF f I CELL * 9 1$ nXLt- 

jgro Q» Jl BQ OQOECO 2 
T«iaf'n> TO c.l 39 CCSf no to q.a 4\. 

cnnXTxoiu juiocxatsd vxtb tbzs gourioN : 

tr OoOTA « I CILt f 9 X9 fOU. 

Aina 09 39 9u guu^(ii^ 3 

TmlBQ TO Q.9 39 BLOB 00 TO Q.f 4L. 

<« COHDTTKMir. AAAnmTffA VTT9 TWTff Onn.STTOf« : 

ir 9 1 cBLL I la zs roiL 

COVOOCffi 4 

.9 Jf fUC CO TO 0.9 4i. 
rZdl^TO MkLUXtt 63003 090TAC 
OO TO < I > « 

30 TO lfe*4AiS^^> < 1 > tr 



tCanuXTZQMAL r 21 ^ 
<co(forito<m> i 221 


<rownTTjc»««. I 291 

(CwarrzoiovL 9 H) 


tOOMDITZOVa f U) 
<CONUAi 4UMAb f 291 


(COBOITXOAL 1 3T) 

fCeiffitrZML 4 20 ) 


Dl/SS/Od - 2 :ic ra 


A5JOCXATTD VITI TEIS QiTUnO^ » 

. _ JQK(C| 3 (Coiottienaa « spf 

O > ♦» ffjtf <>i Th Q.9 i9. 

l-ilii* *n yf»i| KtjAllWMUUtf «ml «Ak iriviKhAff >«»> 

«r ro^ftO 9A«b «•« Safon tMAy M praeaftiy 920 MDX fcou 


TO COftrXHOC) 

< T > 


9%«te«caB haj be«d^ p«Ljifc«d «a •««« »«eka9a« •£ 
myi: QUOTk. li»<rirn C9U999 liir>o naarc 

y coft^licac# pzoonancy. TW) QOnTK. 




y««i 

1 0«*O9M.y 416 POT hfli 

TO (B 
CO TO a 


« 

1 > rawkialkXy iMU 

S« 1 



^ OfTOaOZy 6>16 aifr 

3 > rVOL) Daa'T 


4 

W TO ^ 



4 * (VOnUf 


1 1 ii^836saii9 1 & 2 a 6 Ox cccs 6S ‘ 3N! iNttT“:wa AanHo a:i S3s2i raaz c? “^ar 
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Qa»ri&K « 43 

<>3,21 » fSfWlT 

l‘li iSf^L. ic r«»lly his^r ot a lac it C eeuXe 

ikzQ fct youc iS$T COSSC. yvu've tu>t oa^le^ciy suf. 



^h9Xt. 




«p»»«ifioii 4A* MiCir# tiAfY 


TTvc first, jtirft* ^«s DMo prlnrsa on %oma p 4 QitS 9 «« n** 
c^Msstts*. It: ««y*> ^9TS» tMkiny cukmi lunf cvtcct, k*AJg% 

«]«ky««Mp SAA mMf ccapllc»c« prsfnsncy, tm> 

&A you cAln^ yvu pyoaoliXy old Msr or r«*d disc sxsc—nr bsXors 
tdday, ox 4* you Ukiak v«« anbftbly 414 MT hssr ox xosd it? 

GO ^ Q. *44 « t X ^rottfhly OtA 

00 ro Q. f 44 —>> 4 2 > PTfl^skly 414 IVT 

ao TO ^4, 4 44 —-y € 3 > tVQX.) DquH ki«o» 

00 VO C 4 > (VOL) lufosodi 

ouu^^^iTix 

-QiZ)' 9c ctctacnt mas made In ny the SoryoAit cceeni of 

the rifiTfM unesa )cti ie Rhe federal oevereaenr. is r.A pmtmat 

ane sAvwiee^iPMlhoslth •£ m11 wericeeX- a« 4-sl4r OoOrs. Gl^execvo 
•“'hleg CcattSBHkLVJ reisced to luog •emnemx is both aen a04 

of doToloyiAf lotg onerwir Ls l»exoaae4 vitk 

tam gUOTC. 

preasoiy «ic h«u- or rose cast •tetoMciT a«r«s« 
chXak ymm pssOeaiv ditf »0T hear or rose ic? 

< 1 > xre^Kily AlA 
■? 3 > ^SOOEsOiy -tf* won 

Cl^/2%/00 >> 2 rlb m 



> |»<h.3 

> ITQZ;.J 


fim * r VM^ 

TQZ;.J nsXttSOd 


•r ceac. It wotLLd rosily kolo os • lot 1 ooold 
0O(ESS« 0*00 1C you’re aot nfieff^wf:«»y mrm. 

(]u*snofi ons MFo riooT 

S' •: 

^. 27 t* ^fco.J ieaV KLoUMone osa osUa la l>t» by XM 3 U 19000 OSMXel Ot 

Ohs OAicod Stst^* o h sso )eb in the roderai foosMosot is ts yxotset 
acoi aaivsneo tooJhoelkh ef ell AesaiceM. Os «oi^: gdotC Oigsxotto 
CMlOBf [g|jij|j||giaiy {OUm-AlT] ceiatM to los^ raiteer in Met ma and 
t>fc of Iiu>« MOMr ia Irvuaucd wlOi 

. cm> goOTE. 



|21 B^etrsssBST62B6 oi cecs BS'dii 3NIxNtn loa xanaa mj ww 1002 C2 Nbr 
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ch» you tbxnt /Ou K«Ar oe r«4d wattta«ne 

%pd«y« ur d* y«u ihiAk w%B •^^bdbly did HO? hesdx or r«*d JLt? 
tc» tv) Q. f « I > ifs^eariy oie 

oo fO Q, • << > < 2 > •xobAblr did dor 

SO 90 Q. I 41 ■■■>■ o < 3 > cvOt.} GOTk^t. 

00 lo ?. » 4> ■■ I n ^ 4 > rvoi) HttXuccd 


•*• aJ«STIJ« I 46 ■••• 

•0>2^ 1«JC RAbCMi'.t «di is lSC4 j.o • rvoorr of CUc M«i»ury 

rn rlfc^ ,4iTr»y"nH <?d«#1fAL. tbA tC«t«MCC l4* go:«t^. Tbd diCK 

•f 

(teTdloplJ^ land CASCdltf iPCXM*«io «iUii oC i^akSn^ 4rwi t**9 


df clforocMd 


dkM ddy. CHD OOOTC. 


Oo ydo tliialc yod ypgiiAfc^v did h«49 •r rd«d tbdt stAC^acbt &cfoc« 

iMUy^ uc. lAu ywu Lbiuk fsm pr'ee^mgtiy dfd WOT HMr nr n*Ad !«;? 


OO TO ^ 1 6i 

00 TO 0r%5^ 
00 TO 

OO TO ^pi 6i 


■kA < 1 > gnoUAbly d^d 

•d < 2 > rroOdbly did MOT 

< t > (VOLl don't kacu 
»» < 4 > IVOL) Andudno 


fa.*3 • 


C* 1 I 

4i«» fWt 'rood 


- 4 . 22 ^^ d 
Adviaocy i 
rnUiBi4.L*M^ 

d«<rmiopifj 


Lhat. It Mold rcAlly A«lp u« a Igc If t amM 
CCUCSf, «««n it y^*n Mt c—yidcdly «4r«. 

r qoavxi^ ««« *4t* rl oov 

^flmrvnonr ^49 Md* ifi 1»6< IB « rdTort of uid 

RMCiMrMl . TbM MfiNL*^pmr Jk> QnATK . Th^ riflt 

r^jncMx incTdAddi «iEb durction of gnsKiCig U(« 
MM war ddy. aio oooTC. 


oo tc 


OdedtidbA 

Tifa: 



pj;drably did Adu *■ r«*d that dtdtaaidAt boCoro 
^Kind yon proMBIy did WT Baor ec n*H 
1 ) J < 1 > Probably 4L4 

y < 2 > Pfabdbly did bOT 


> < 3 > <'^311 Pbfv't know 

> 4 > <V0LI MfuMd 


... oouxlob ♦ *€•*• 

AdCocidrcc BXTm ToIC QOUTIOil 

ir ] (CodPirzam. » 3>i 

TMEB OD 40 0.«, «l ttSC OO TO O. | TS. 

•eneor e Sa»|»«as^ 

t. r^M yTH I ^n.. TL«WMMUV» jfWMi 


01 eEC3 BS-dOT 3N[iMo-naa lanaa ad uw 6^:21 1002 cz no; 
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•» each «o4«r «{ o<uUl,;y ala *« "•••■ 

»r ccad ftdclb •cc . 

(Mtsy crMK TVICC TO cOfTOWt I 
00 TO o. 4 4> =—> fi \ * TRjtt 
— TtlCT SC»*ni -- 





--• COMTTOa # «s **• 

TM tlx«t etat«»«*c »«4e !« HS3 by an K. J. Myonlrte 

TaMcca 

L'o^sny ac^leyaa ui a rc^ac^ Tax tha« oaaiMny. 71 im rabOfC 

990Tt. jeucu.«> of elloicai o»ts to oofiflcn C 0 « reLoti<3C\i4b-Lp 

betwcui 

Arui t'sMCoo MeJonf bm lAoiOoaoo ct BBteof of ihm 

SM& OOOTB. 


Do you ^ir.k yau probot^l# hwar ot* T*»ot otoco^oso oooos^b 

wg ntifix ^oo p<oa>ii i y MOf bcor or it? 

^ < 1 > mbobXr 4i4 

OO c g > >gOP ohl y y^T 

w roPO' f < j >* tvoti) Oon^t kA«tr 

oo lOaft. » 5%s—«—> < A > fvrrr.i 


r obOB. ••Mij.a r««^Ay hoiy as s lac if I omIci 
CQSttf •1*OA if :yvtt*c« COOO^iMLoly «iiro. 

^aaclaik oae soeo liaof 

^ jxw^mmt wo* «i>4« i« ifS) ^ ob a, j, a«yMAi4a 

To SgUpg^ ^j ipIoii^* lit • 4Wi*vt wyiccM for char <*inopoay, roo 

ro go^T. octKil** ti ei toiciol 4»c« too4 to coAfiM tho 

n i>>iail.JDt«.s WooO Kaoyy *04 pgoio^^^od CiJiMCUo vaotlAQ and inctooeeo 

iMfig. CHO 

you froBobiy Aid tMMJt or rr^n rn*r «c*c4MOt Ooroco 

Of o^yoo^chiAt you pradabXy did tlOT haor or rood it? 

TO i8^-* ^ ^ ^ fcoboiALy did 

. to n < '4 % rvoDoniy odd wyt 

' TO ft. ♦ > I >-■ » < 3 > rWi] Bpo^t Kw 

TO * * 4 > (VVk) «d«lddd 

eCAtcflMt wo* prloctd x*c*dtly lo nemwodo* 

OniHp twvr-rio Q90C idUfH 1* * CbImcco cowpOfty. 

. . aifurott* odohiaf «•**«« iodd d*Ac*x« Kowf 

O»^d/OQ - 3iIC fM 




oral Olbo* oorlovo alaaoMoia 1 
ily Co tloiol ny ooaloM* diiioocos^ 


« ooojcaro. 

like loM 



Tni.«v6S9ttSte2e6 


01 cccs 


6 S*dm 3NIXKW“l"twa 


A3n3C BPt2t 


}002 C2 Ntjr 
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ciLAf^ . CMC QOOTC. 

Oa V6u Lhlnk you a-#*rv«oiy dkd hmzx «t *•*<< tM£«r« 

at 4o yau wu ^ <1*^ iiOT of read it? 

ec TQ q. « 5) < i > <li'A 

«> TO Q. • »J < 2 > tztotiMT 

«o TO C. I U -> < 1 

00 TO 0. « M M*I»> < 1 > (VOLj A«£u«vO 

• ** oee^TXOii ^ 42 *■- 

[0--'u e CCBV*-: i9i«wi 

I'll ftdkd « «^ac« «r It rvAily iu»ip * lae if I c4KAid 

ai«Q Tat ya«r BEST OUSM, «¥•#! \t ya^'ra natt CMpt«t«ly 


I ra«d Oka ^«BCi.a« ma : 




7*^ A«ic sBBtMBAt o«« prlnr.M r««««ti.y ifi «aMBpa#*r 
44a%rtifinu Uy fltLltp Mwsia 00^^ «4iich i3 « tabMauu cc^tny. 

It UMOiXr OdguttCT tmokLan caw.^ eoiaar, booot 

cU«C4««^4»K^«m. 4iAl nrnar aartBdd a4^*B9W ia mou^w^m 

M£m Italy CO Maei-Of^ aac^aua fli ry ITT i io»9 casaair, 

UlWl n^^pBnl^v* OtO UUUtC. 

^ you ^||.OMt«>4l«u »«a»4biv 4id tMt ctai^Mv Mfoca 

ce«&v« tMttk ym ptaMbly 0i4 IVQt %%%X w ivod 

00 til mm^y < i y fsabablf did 

^ ■'•* < ’ > rrvotftiy did VOt 

GQ *»t»for^Tri —> < 3 > tVOll Odb* L Iuvw 

« —• 

I «t»^^a«ikt aadB roodatiy ^ tl« cK«iinBaa and eKiof 
^ of llraan ■llllAitdCn ToBteea CaxyaratMCi. Ba 

itb t4a judoMakt vf puptl** iMvitrii •auioifiti.e-a t^t 
,« uX 1 iin^ ruiC«r> CUD QD 0 n« 

Biy«p4Uiy did Cddx or r«a4 tixuic atdt«««AC b«fee« 
lo ^ tHiAX y«w PMtoably did HOT tkMT at rmtd it? 

4| , ....ly < i y aiiifcately dad 

4 #!—< z f»Mbi.y did wer 

-^ < 3 > tV6L> nofk't dr aai* 

4 A > tdOt} Bafwwl 



'• ox cJkae. t« ttwald caaily balp aa x lot iS X aoBld 
OOtM, a^ati 1£ y«ii*T* and ca^Italy auxt. 

0[Ba«Cl«e Odw Mm Cisa? 

.T^ ^dt add a—hi rmdntiy dy CBa crMiraafk dM oXiidf 


»19« 


ai/uyoo 


2il4 Ml 


:i«iE^GS 9 na»e 2 aG oi cccg es rf-n gniiNW-noa ASnsd dd Me 61 ^ = 21 i00z cz 


I 

'!( 
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cuceuti^e o££ie«r o£ «iid luL-ccrt Cor^wriCinn. H» 

QVCTE. K» «*!«• •'ItA cJici •£ p>ibl.iE h«*lu» tuit 

jaskintf i» • 0£U1« «C lunw rr.nwr EWB QUOtl. 





Bo yay tbink v«u probakly al« Iitui uir cyyd £>u' ''^>r*w>n< twEsr* 
^rtrtny, <*r <10 you tBi-nk you p*oo«Biy o^a SOT hew o' r*A« S-t’ 

CO I« Q- t ta ——> e t > rroBobiy <414 

00 to 0> £ *• — «■ > > “TobAbiy did bur 

03 TO C- * *• —1 5 1- (VOL) Don'C kaoM 

CO TO Q. t as ' ■ " > - 4 > IVOll XdniuMI 

'•• QOESTtaa t Si -" 

•S< CflMOtTIOlWt- kSeOCtklCD BITM iKiS UUCSTIOb » 

sr Qt ku BO coocici 1 leoHDiTiowu. • >i) 

TW 90 to Qt# 99 (V TC 0<^ <9. 

iCIlOQP 

*^.40^ X'^ l-kk« ea TMAii yow ¥ca* v^st«Mncv «4v«CftCff 

~ ••e2w anc befor* •« pEobtkbiXy old 90rt 

«C raad 

CC TO COtfriNOC) 

L > Tca sc*wi 



4 

9Ul.«9e3C &AS bMA pr^nr^ 0 ”' pickA 9 «« •< 

OOOTCi ftadkinr catMd* Iw? qaaciu:, tBsa.iC 

y ca^H.eat.« psoqoAMy. CKO 0^3OTC> 

Do ytmi ym| ptf^«bly OU tu»»» •« n«4 CM; auco^oafe 

tQ^y« rAlnk y«u g gob ably did HO? boar oc xomd it? 

90 to ■" > ^ i > OT-rariMtiy die 

CO TO fi' ^ li < ■ > < 2 > Probably cUd ir?T 

^ ^ 9 {VQLI QQr*C KMd 

;0 < 4 > (VOi) ftofuood 



Z'll 9bh« o notr. oC tbotA Ic rruld coolly ii^Uf ^ « i«l U t cflulq 
Ai«o <™«y or^ 4.f y«tt«ro hoc Pif ibtoly ooro. 


9hbU t 



<o i^LjMtoLiiai oott » u fr rtihr* 

r^ rcrccsoac kvoo brm pcLnkod mamm oT 

CMTl. teoklng oaoowr Iwbg c*nemsw hear* 


>y «M9pIiaitb pFO^uoejr. oqp QOOTS. 

prntMt^ly <^14 boar or road tJaat bcocobont bbCdco 
think y *4 tnlMBly 4id WE b«u or read i.!* 

> c 1 > mhasty 4i>a 

> A 2 > Pnbnbly did wrr 



IhlByESSttSiezaB 0l CCC9 


cs'dn aiMiibiwTiHa Jonaa aa ub 6 p:2i 
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CO TO 0. ♦ i( i > !V0L1 nfm‘^ Venb 

99 ro O, ♦ m > < 4 > tvctj 

oocrrroii » ^ 

Ri*«: 5136 0»/7'S/iM - i'.lt ^ 


5^" \ 



-u.<2- TU lecvn^ xtAtoKAC vu M4« La ir?) by Llia Siin^vqn emariyl at 
Uw Sniteii alMat in fndukl ^o^vnanax It t* M«(ecc 

• M 

Ad^4AC< hvalUi of All MMAlCAnj. 4« c4t^: itiMjrK. 

smoXint 

XM CAuJUtAy (CAOn^-^LSf c«i«t*4 (.9 lucia 9«ae*v le OrtfN aan tnm •mmmn. 

rte tl9h mX T<m<j CKAC^K U ^Ith 

cto««fv« 

• i SHD OOOTt. 

^ 5U<I r»»ri chic ccac^vk mr«xB 

rntnic y*9 pcoba^y «x4 MOT boar ec road i.^? 
ao » < 1 > jrao4bAy Aio 

Sfi 70^. • #0 X 2 > PMBlbly did {•97 

^ -< 3 > IWiI 6»a*i kA«M 

aO TO ^ < 4 ;» CVn^'A 


(Q.4X 

*** ^^^ ^W nt •^•jxa roAily hdl^ ui « Lee if Z could 

Aico yot^j^^^jggr CVUSt oroo if fM'ro itLi ooopi^oly tuc«. 

$baii i gu«c«taii oa« oar« 


-C.4?#- 
„ Otis 


■ICC ^1 g o^c la 1979 by eba 9uxymaa ft—i>ai4i 


“o*Bo job is xbm fodogal govampcikt ii co protovt 

fc-TOcmM. ■« sud: OOOTCn CiCTOXavcO 

rolatoa to Imm «iBc«r m balh am and mown. 
eane«r io laeroo»4d -i^ti ioenuiM 

do r ipio 

of laoimiflr. K. 

you «id Mar or road Ulac rtot—oat bolor* 

*o y'** pxobably did MOt hoar or ro 4 d iff 

QO TO Qjn^^lo^^aaa < 3. « Brabahiy oio 

“ ” ^—* ■* > » c»»b«>»ly «ld mrt 

W TO Ijr* M« J J (W0».) fkin'C JAM 
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laTiinry*^ 
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IM Q8/Z5/O0 - 2::f PK 

QMSCloo OAa mP* mjJitoV 

tT^ «Tsc*«n« M4 N144 in itC4 ui 4 r«^4rc tm 
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JM4 Utov. OfD OOQtC. 


04 vow «1 
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iMayy c«rf*ac«» nnr~^**tJ ^nd Inclowrr'a of canu^ ot eeta 


pPObably 44d Iima ml imad UmC av4Lci«4JkC b«£ox« 
TbiAJT yvu pa««*i4Ay did Mr 444z ox n*d 1C7 
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•lao fltt roar itar 3Ur.^5. <^*n l£ y«c’54 c^ii»t^y «ar4. 





Ohall £ r«ftd c±ic 4 \»c 4 tl&u 

~^.44A- Th 4 ncT^c a«4CC*<Bk Md* ix> X9&3 Ay 4 ji A. J. Ri*ynr>'i<l4 
Ciii yay mnpLaymm !■ 4 re«>o^ writtaa Cftr Owt c««B*ny, m* iia^r-r 
gucniK. »^uai.«t «< (uiAleai *»t9 t«nd xm c«A£lxm th« r«l4tlarAbip 
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‘^' cxu^k yM probably di4 MOT Kcat «r radd 14? 
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< « > <VUiji Maeusaa 


n«««. vac ^cavACly lA «• 

ttklliio? inJk« HtUcb 44 4 caDAcco coapAiw. 4 .C 

^ ei. 9 »x«CM ca«« 4 A^ 44 u 4 m long M**ar» hCAMt HLtaaaa^ 

piMr miaua 0J.»M»4P in ngfears. Sxokmvaa xrtt ft 



lika lumi ^ancar. r.tmn uwii^ 
gi/;i 4 /oo * Pff 


pAtaoOIy cUd bkay read char dtkCMaax heier* 
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1 > OaeOaOly 414 

2 ^ rEopiniy 414 noT 

3 > fVQLi 0mm‘X 
I > |V0Z«) IW£a4«4 


t0^4» • 

X'LL eak ^4 ftOt^t (J\ 4 L. £l XMlly ludo^ u« • lot il I COold 

4140 fo«‘TOUT IM^ uu 4 B>, aroA 4 < yoa're n«& ooapialely 40 x 0 . 


• 4 v«n iateeiil 


• 40 «rtL 0 A OVA« •»«« tUM 7 


j Wt9fmm n z v** pribtod rocanriy 14 a^tpvpw 
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1 B^6^fiE9>a iszee 
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cAa<«c iu*y c&ae««. M*r« 4Xzcaa^t 

ja^ilij-T^* ecit«f various 4J.-JC A> iia Lr AMk«»«. C«otmrj mrm Sax' 

C» 4«««l4l9 Mrs-eofl 4i.B«AC4«« likv aaACAXf ^OA AM- 




Qo V9W wu BvobJkDli' uj41 lm^£ n«i; tli4c at^ccMcC btkfnr^ 
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yi Q. f 6C ' > ^ 1 > Px ijUal.lI j* lilU 

GO TO O. t id wMw> < 2 > Pr««40X/ NOT 
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H9>4d- lAsx rtdt«ikdA« n^a* iM* ro«««l|’ ay eh* ca-siabm aad cAlAi* 

MBOOUti-T* •ffi.otr *t Acawo 40ci HilXxao^oB Tebooco C«94ia\j4«LJ.wo. ■«• 

■ «ld,r V 

OOQTd^. ludviem of Nu fcllc h^olcH dutkositiv# c?uit 

aoOkJUid In . 4 or lui<v CAACor .' ^Nf] OO^PV. 


Oo yoo <hi4w 
codoy. »» ^ 
00 TO Q.PF 
GQ TO Q. 

CO TO Q.^ 
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SKOOob^/ tllil i,i4«c rwoU t-hM.4 iiiii n f»r bA^ooo 
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< 1 > frotoAblr *^4 

ii4 f »>a- ^ 'd ^ OrMd»Xy dxd NOT 
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I'XX uk« U\AC. AT WOlXId roBi-iy A«ip a# • ^dd xf X OOuXd 

•lao get EUteTjQat£S» orm iS yuM*v oor coapioccl^ »ua«. 

£NoiX Z ofM aor« bm»? 

ccaftdt **49 «A4ic rcccRtly by %Ami ehoinMi oiKi dlii«T 
9 XZxC*Va£ Ixowu AUU OIIliaddAn TobnfiRB rAfpnrarZdA. So 

Urn. Hlrh the ^udgMRC at public bdidCt di4ChOJ^-i-L-l*a bbat 



ewteffcf i« a 


•£ Ltux^ cdncev. KUO 40DTC. 


9o yoN BKPbobly did boiur m- Mod tb*K — i*:—Wtoxo 
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A TO a.,4 dd ■■■ &" > < a > rvot) oco^t koaw 

^ ^ ^ rvoL) Aatucoc 

•-• owmSTiM ?•• 

‘.Ktt KVtUYBWaSjm^ 
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Ocaax 

■agai 


ef That. If yau ilun'c mtad. it aaold nally halp 
al«o cat yau* narz SOSSS, awaa it yau'ra nat 


CueJtion ana boct Liaw? 

wa <Kze ta iwaluoty ettaoaa, osarteoosajia baarlcsn 
malaaa et.Taaattww KT US. •bMAf wbala Ilwca, hau 

aanfl paapla aa yeu tfou wwuld *o» Inn® aaaaaa 

a-ioea; ^a-x in«n« a lam2 wataaad * looai 
■• 919S OO/ZJ.'Ba - Z;H *« 
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^li# C-RRR CHtol(04 tttt #2 « Oty« V'r^^jr ai«r fnr- 70 yin 

• lahni a.tai7 ««|h 70 ytrt AL4« AM/ 9t tiMtt oa^-th^waA 
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jljtd^ quirgi oil ofit aoro tlAO? 
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< 1 » acMjiic c>fSA Blau (o«2oaai 

dV'fiH P« > 2 A 0 CM ts 0 . rUMO 10C9.<- 
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